Simon Cowell admitted to Esquire UK that he would want to leave his fortune to a charity, not his unborn son. Credit: Jason LaVeris/FilmMagic

Simon Cowell has his priorities straight. The X Factor mogul and former American Idol judge may admit that he feels a paternal instinct kicking in recently, but don't expect him to leave any of his $300 million fortune to his unborn son.

"I'm going to leave my money to somebody. A charity, probably -- kids and dogs," he told Esquire UK in a recent interview. "I don't believe in passing on from one generation to another."

"Your legacy has to be that hopefully you gave enough people an opportunity, so that they could do well, and you gave them your time, taught them what you know," he continued. The interview may have been conducted before news about the baby first broke.

Cowell, 53, recently told the Times of London that he feels "very paternal" recently, now that the reality of his baby with NYC socialite Lauren Silverman is sinking in. "I can assure you: I won't go soft," he quickly added.

In July, Us Weekly broke the news that Cowell and 36-year-old Silverman, the estranged wife of his pal Andrew Silverman, were expecting a child together (the Silvermans have since finalized their divorce).

Since then, Cowell has spoken out several times about anticipating fatherhood -- though not necessarily all aspects of it.

"Once I got used to it [the idea of becoming a father], I did get excited," he told BBC Breakfast in a recent interview. "I think I will be a good dad, so I'm excited."

When it comes to dirty diapers, however, Cowell was quick to evade responsibility. "I'm not doing that, 100% absolutely not going near that," he said.