Three British government ministers privately support the idea of holding a second referendum on the final Brexit deal, a former junior minister said on Monday.