Credit: James Devaney/

Despite his notorious playboy image, John Mayer -- who has romanced everyone from Jennifer Love Hewitt and Jessica Simpson -- insists he doesn't go after that many women because of the scrutiny on his love life.

"It’s crazy to me that in my head, that being 32 and dating women is going to get me in trouble," he says in a new interview with The New York Times.. "I can’t even explain to you how terrible that feels, that I equate dating a woman with punishment, shame, guilt, disappointment, reproach, reprimand, persecution. It’s a nightmare."

"I should be having sex with more girls," he adds.

Don't expect him to sing about his past few flings on his latest album, Battle Studies, either.

"What is the odd man out," he says, "is it the record or the coverage? I'm not going to let it be the record. I think if you're listening to Battle Studies and you think it's a record about high-profile relationships, I haven't done a good enough job."