Credit: Dave J Hogan/Getty Images Photo: MISS: Nicole Scherzinger Sings at Radio 1's Big Weekend 2011 in London on May 14, 2011

It’s harder to be a judge on the X Factor than it is to be a judge on American Idol or The Voice, Simon Cowell tells AOL Music. “It’s not like the other shows,” Simon explains. “We do have to work three or four days a week with these contestants. So while we're not on TV, we're spending time with them and we have to make time.”

Simon recently made the controversial decision to ax old friend Paula Abdul as well as shiny new friend Nicole Scherzinger. Simon breaks down his decision: “They did a great job, but the Paula thing was simply that there were too many comparisons to American Idol.” As for Nicole’s Season 2 replacement, both Britney Spears and Avril Lavigne’s names have been thrown in the ring.

“You'll see when we announce who we've got, but they just wanted a different kind of person in Nicole's seat,” Simon teases vaguely. “Star power is important now, but I think personality in the long run matters more.”

Source: AOL Music