sounds like a desync..
either caused by using raw, or by using third party modules like ircd_init that do not properly handle desyncs when they put clients in channels.
or you are misunderstand what cs invite is meant for... not a lot of details in your description..