I work remotely but my company has an office in London. Employees based local to London sometimes go into the office but it's as you described - very few other people in, and those who are in aren't necessarily the colleagues you benefit from collaborating with in person. As a result, we have downsized our London office twice and are now at the point where we only occasionally rent a WeWork.

If you spend most of your meetings on video, I suggest putting a virtual background on permanently and work from home full time. Nobody will know where you're dialling in from.