What special privileges?

Sex-segregated spaces for one. For another, is anyone obligated to call a Catholic priest "father" simply because his beliefs give him a special title? Of course not. Clearly gender is not treated this way.