Talking as a mostly straight woman: To an extend.
Women like confident, assertive, high value guys.
This often overlaps with "jerks", or, more correctly the cocky-asshole, in a funny way, type guy.
We don't want guys that crawl to our feet, put us on a pedestal and do everything for us. This signals that the guy doesn't have many options, hence he can't have great value. Now if a guy teases us, challenges us and isn't afraid to upset us a little bit, not putting up with all of the little tests we girls throw at dudes, that guy clearly has other options, that's what we like.
And often, the jerks are just like that.