British education minister Gavin Williamson said on Monday it would be right to deselect any lawmaker from the ruling Conservative Party who votes against the government on Brexit.