"No, they happened," Tony finds himself replying. And if anything, the Buffy reference is what makes him think that maybe, just maybe, this Loki is telling the truth about being from another universe. The Loki leading the invasion in New York had been more than a little unhinged, and completely disdainful of pretty much all things 'mortal' and 'Midgardian'.