The gag kicked off when DeGeneres, 58, pointed out that it was the country singer's 10th time as a guest on the show. In honor of the big day, they looked back at a photo from Underwood's first visit. "You look beautiful and I think I've gotten better. That's amazing, right?" DeGeneres said of the throwback pic, which was taken in 2005.
"We were babes. Just little babes," Underwood, 33, chimed in. "Right after [American] Idol I was on."
DeGeneres replied: "I should give you a gift of some sort."
Unfortunately, the present was a terrifying one — a life-sized Jack-in-the-Box! At that very moment, a man dressed in a hockey uniform popped out of the side table. Underwood shrieked and covered her face. "Oh my gosh!" she shouted when she'd regained her composure a bit. "Come on!"
DeGeneres laughed, quipping: "See, he was dressed like your husband."
"So proud of my @mfisher1212!!!" Underwood captioned an Instagram pic of Fisher holding up his jersey on September 8. "I see how hard he works every single day…he's going to wear that 'C''well!"
Watch Underwood's scare on The Ellen DeGeneres Show above!
Sign up now for the Us Weekly newsletter to get breaking celebrity news, hot pics and more delivered straight to your inbox!