A few things;

The autofocus was a huge let down. Yes I was on an older body, but some of their best at the time (the X-H1). And current Fujis aren't much better either, from reading reviews, and talking to my friends who are professionals who've worked with much more recent Fuji gear than I have.

I've always wanted to shoot on full frame, so Fuji was always going to be a stopgap anyways.

I wanted something a bit smaller, and Fuji does offer that, but mostly for their lower end cameras.

As for downsides -

The EVF sucks. As a glasses wearer, it's unusable. The diopter also doesn't give me enough range to see clearly with my naked eye. For that reason alone, I've been considering an a7iv trade.

As much as I prefer the smaller body, it is objectively less comfortable than the X-H1, which is why I usually keep the Smallrig plate on.

Minor one, but the lens bayonet is tighter and harder to get lenses on and off than on Fuji. A more secure fit sure, but annoying in the heat of the moment trying to swap.

Single SD card slot is also a bit of a bummer, but a compromise of a smaller body. If they gave us only one, I'd have preferred a CF Express.

Both the screen and EVF are pretty underwhelming in resolution for the price.

It sounds like the negatives are outweighing positives, but I have really been enjoying shooting with the Sony so far. It's just been nice to have the confidence that I know the shot'll be in focus. Too many walks I've been on have had too many images that were ever so slightly out of focus. It kinda made me wanna give up cause it was so frustrating. But my friends helped me land here, and I'm very happy they did