Actually I finally found out what it was, knew once I posted the answer would magically fall into my lap.. LOL
Here is what I found, so guess it's not a problem..
My server sometimes sends messages saying "Notice -- User on services.example.net remotely JOINing new channel".
This is normal, and happens whenever ChanServ kicks a user from a channel in which they were the first to enter (for example, a user without privileges entering a channel with the RESTRICTED setting active, or a user on the channel's autokick list). In this case, ChanServ joins the channel for a short period of time to prevent the user from joining again immediately after they've been kicked. If you are using the Bahamut or Unreal IRC servers, this will result in a message like the above; it can be safely ignored.