Well, maybe the guys don't...
Seriously: the thinking is if you don't remove the car bra when you wash your car, then moisture may get trapped between the car bra and the paint, which if not given a chance to air out, may eventually ruin the paint.