If "send key to all members of channel x" is enabled it would be good if that would work.

You can set it to "only other clients and people I have personally verified" but that is quite cumbersome for big channels that just don't want clear text.