Tweet Simon Cowell is reportedly looking set to return to The X Factor UK for next years eleventh series. Simon left the show in 2011 to launch the American series alongside Cheryl Cole , but its not exactly gone to plan. Cheryl was ditched after just a few audition shows, while three years of subsequent shuffles with Simon the only person to have remained on the panel havent won over viewers. We told yesterday how this weeks launch of the third season saw just 6.2 million viewers tune in, with the show being beaten by the American version of Big Brother. It was down almost 20% on 2012s opener and had almost half of the raw 12 million audience that the first season premiere had two years ago. And with the X Factor UK looking to be in need of some new judges next year, the stage is all set for Simons return. A source told the Daily Star newspaper today: With Louis and Sharon and Gary all set to leave at the end of 2013, its looking likely Simon will return to the UK where he is loved. However, Gary Barlow has insisted he may not quit, and said he would love to work with Simon on the same panel. Ive always got on great with Simon, he told the Daily Mirror today. We have our meetings in February or March and he has never been anything but a gentleman to me. Ive never had one of those calls where he has said, Change that or Do this. The X Factor airs Saturday and Sunday nights on ITV.