'I'm single!' Brad Pitt confirmed when he was accused of having an affair with Aniston