It seems like maybe the sources who spied on their conversation may have misinterpreted things.
"You have a conversation with someone, you're just like, 'Okay, well, I guess talking to people is not a [relationship],'" Olsen told ET Canada.
"You know, I hung out with Tom Colicchio for 20 minutes," she joked.
Elizabeth is used to tabloid gossip, being the younger sister of Mary-Kate and Ashley Olsen.
"I grew up knowing that everything that was written was fake and so I don't even read any of those things," she said. "So for me it's just not part of my life. I don't want it to be part of my life."