Prince Harry has refused to say whether he will return to the UK to attend his grandmother Queen Elizabeth's Platinum Jubilee celebrations next month.