The Rav is an excellent, reliable vehicle, and I have not noticed any particular trend in the gender of the people who drive them.
However, this just has to be said, IMHO:
If someone's concept of his own masculinity is so fragile that he worries about the image of the make and model of his vehicle, then he has much bigger problems than just selecting a vehicle.