For Gary Barlow maybe but we reckon Louis means every word that comes out of his mouth.
He told Jonathan: "I think we're all quite protective of each other although the gloves do come off on a Saturday night."
"We have a go at each other, we have a few jokes and we pick on each other, but none of it comes off the stage. It's all for the fun of the show"
[Related article: Nicole Scherzinger: The X Factor boys are more pampered than me]
[Related article: Nicole Scherzinger: I should've won an Emmy]
This year's most controversial contestant, Rylan Clark has split audiences and judges alike.
When asked for his thoughts on Rylan, Gary turns to Nicole to try and force out of her what she really thinks of her contestant.
Gary tells Nicole: "Come on Nicole, you've got ears."
But Nicole Scherzinger is having none of it, defending the Essex contestant.
She retorts: "His voice has grown and he's not a big ballad singer, he's a great performer."
Well he's certainly a performer, that's for sure.
Gary also reveals in the interview that he is a big red wine drinker with Jonathan asking if he ever gets drunk on the beverage during the live show.
The judge admits: "That is actually slightly true...I don't drink during the ITV1 show but as we flip to ITV2, and I realise less people are watching, my tea arrives and it has got red wine in it."
Well if Gary Barlow is at all lairy tonight we'll know the reason why.
Watch the full interview on The Jonathan Ross Show tonight at 10.20pm on ITV1.