Given the demographic that suffers most from the free movement of workers is the traditional Labour voter, I'd say it's fairly safe to assume this.
I can understand people voting leave, as the neoliberal EU project has hugely increased the gap between "haves" and "have nots".
As an educated, experienced Engineer/Project Manager I was fine but I saw first hand the artificial wage suppression of skilled workers lowered by the influx of supposedly qualified skilled workers from Eastern Europe. This suited the international companies two fold in that they saved on the expense of training youngsters plus the influx stemmed demand and lowered wages from their true worth.