The TV veteran, 85, talked about his fractured friendship with the former soap star, 46, during an interview on Larry King Now on Tuesday, February 14. Watch what he said in the video above!
Answering a question from Larry King about whether he still kept in touch with Ripa, Philbin admitted, "Not really, no."
"Never once did they ask me to go back," he added, even though he hosted the daytime talk show for 28 years.
"She got very offended when I left. She thought I was leaving because of her," Philbin said of Ripa, who joined Live in 2001 and sat beside him for 10 years before he retired in 2011. "I was leaving because I was getting older, and it wasn't right for me anymore."
"She took it personal?" King asked.
"Yeah, I think so," Philbin replied.
"Haven't heard?" King pressed.
"Never have," Philbin admitted.
King also asked Philbin if he missed being a talk-show host and if he'd ever return from retirement.
"I don't know. How often would it be? Would it be every night? Every day?" Philbin said. "I do miss it. There are times when I really miss it, and wish I'd never stopped. But, you know, I just figured it was time to let go."
Philbin was replaced on Live! by Michael Strahan in 2012. Philbin left the show four years later to work on Good Morning America, but his departure last May was also tainted by controversy, with Ripa claiming that she was blindsided by his departure. She took a sick day after the news went public and gave a passionate monologue about "respect in the workplace" when she returned.
Want stories like these delivered straight to your inbox? Sign up now for the Us Weekly newsletter!