The Office star Ricky Gervais has hit back at Louis Walsh after the X Factor judge used him as a put-down.
