“I don’t think anyone should be working five days a week," the multimillionaire founder of "The X Factor" said. "It’s just pointless.” ...