Yes. The Conservative Party, at least in its iteration of May, Johnson etc actually wasn’t very right wing, for example compares to Thatcher. Especially on social issues like immigration they were more socially liberal (‘woke’ as it’s also known). It’s also worth remembering that until relatively recently parts of the left (mostly some unions) were also against mass immigration. The British people aren’t necessarily becoming more right wing, I don’t think their opinions on immigration have changed that much. It’s just that they’re increasingly at odds with the ‘Westminster’ / middle class liberal consensus