When Britain voted to leave the European Union, few voters outside Northern Ireland thought about what it would mean for the British province.