The car workers would pay a heavy price. The City would be muscled out of crucial markets. The Treasury would be sinking in red ink as tax receipts went into freefall, and farmers would lose their subsidies. During the long, painful debate about the UK’s departure from the EU there were lots of different groups which, we heard repeatedly, would pay a price for that.