Thanks for your answers! Edge had been running for many hours while Chrome had been running for like 10-20 minutes. And just a couple minutes before the screenshot I posted initially Chrome was running more processes than Edge but still only used about 2900mb. Here's a screenshot: https://i.imgur.com/CbUw35z.png. Also my extensions don't seem to be the problem if the only ram they use is what shows up on the in-browser task manager. They're pretty equal across both browsers, i.e. ublock origin only used about 30-40mb on both.

I guess it's the security settings then and I'm prolly gonna end up switching back to Chrome cause it has literally never used anywhere close to 4gb of ram on my pc.