Gerard Butler says he and Jennifer Aniston don't take romance rumors too seriously.

"It depends what mood I'm in, [but] most of the time I just laugh it off," Butler told Usmagazine.com at the NYC premiere of The Ugly Truth Thursday night.

See photos of Jennifer Aniston on set over the years.

"The first few times it's happened, I actually got really upset by it because you think, 'somebody made that up,' and it's a little bit ridiculous. But then you think, 'Oh, you know what...it's just silly. Then there are days it just frustrates you," Butler said. "One day, we had dinner when we first discussed the movie, and that day she had been linked to three different people! I was already one of them."

Check out all the guys Jennifer Aniston has dated.

Aniston, he says, "completely" laughs about reports the Bounty Hunter costars were dating after being spotted arm-in-arm on set. "Listen, there's nobody that's been more subject to these rumors than her, so I think she's just learned to...most of the time, you can blow it off," he said.

See Jennifer Aniston's on-set PDA.

Butler says working with Aniston has been a blast. "She's like my best buddy," he said. "She's so down-to-earth, so easy going. She's incredibly self-deprecating and again, just alive! I'm having fun doing this! "I'm lucky right now!" he went on. "Little boy from Scotland did good!"

Get more Us! Follow us on Twitter, Friend us on Facebook, Join Us Weekly's Celebrity Fantasy League, Subscribe to Us Weekly