I would agree that the EU, or leaving it was a pretty minor issue in Scotland outside of the farming and fishing communities.
Clearly not so in England though over the past 2 decades, where entwined as it is with 'concerns about immigration', it's caused massive rifts in the tory party, support in local elections for far right parties, and Brexit/Ukip parties comfortably coming 2nd or 3rd in European elections.
I think that opinions here are clouded by the fact we had a hegemonic Europhile Labour party for a good chunk of the start of the century, who also enjoyed a certain level of media support from Murdoch.