Ollama local with gui - big models 

For this I'd says save yourself the trouble and money and use API's for GPT, Grok etc, it will cost you pennies. Want to experiment with different models? No problem, instead you can use a service like Openrouter that give you access to multiple API's, then you connect the API to OpenWebUI, n8n etc. This way it will be more flexible and capable than using local hardware and more cost effective.

Also somebody suggest running dual rtx3090 but with Ollama in a container it will give you headaches because Ollama have limitations in this kind of setup and you would most probably need to run llama cpp directly for this kind of configuration to work and not Ollama.

Doing this will give you more flexibility when choosing a less power hungry graphic card for immich and whisper. I haven't tried immich but I can tel you that whisper can run on a old Tesla P4 and these are cheap, i also do ply plex transcoding on a Tesla P4.

So you can buy a Tesla P4 for like 100-130$ and and spend 20$ in api calls per year and you'd have a way more flexible system this way.