I'm pretty sure men do reject women, even if they are attractive and all that. It's just less heard of, because it's nothing we men like to brag about.
Personally I haven't dumped a girl directly. A female friend of mine has twice been a "spotter", and told me if a girl had feelings for me (reading people and their bodylanguage is not something I'm good at). At the time I knew something like that it became a race for me to change my character in such a small, almost not noticeable way so that they'll loose interest before they confess their feelings. The first time it kindof failed/backfired, as the change seemed to make her more interested, but I managed to solve the situation before it got out of hand...
Yay for pre-emptive strikes I guess? What? Don't look at me like I'm some sort of twisted monster... I saved them from me, as if they'd confess I would have told 'em flat out that I wouldn't want to date them and probably hurt their feelings. I'm not really good with these sortof things...