Following her breakup from Conor Kennedy, Swift fell hard for One Direction's Harry Styles after they met and flirted at an X Factor taping. Months later, Swift and Styles were on the outs after a nasty fight during a vacation in the British Virgin Islands. Leading to Swift's speedy exit back home to Nashville? Styles "said something he shouldn't have," a source revealed.