Well in that case, my issue lies with those who voted leave in protest, or without really knowing what they voted for.
You should always vote for what you think is right, not simply to 'get at' a government. Those who voted leave or remain with conviction have done the right thing.
Those who've protest-voted have not done the right thing, for me at least.
The fact that the day after the referendum "what is the EU?" was the most googled thing in the UK says a lot. People have voted while totally uninformed. That's down to both campaigns and the government.