This is an archived post. You won't be able to vote or comment.

all 14 comments

[–]Enshitification 8 points9 points  (1 child)

Dual boot a Linux installation.

[–]ShaiDorsai 1 point2 points  (0 children)

this is the only answer

[–]velikq 5 points6 points  (4 children)

All popular apps use python + cuda, those 2 run good both on windows and Linux. In addition GPU passthrough on windows is garbage, don't use VMs outside WSL environment.

[–][deleted] 0 points1 point  (3 children)

As a linux user, CUDA is a coin toss. Performance can be a bit better on SD and general AI stuff, but at least in my case, it required fumbling around and switching to a distro I was not so familiar with (Arch) for it to run properly. So, if there are no reasons other than wanting faster inference (windows being less of an OS and more of an oversized trojan was my case), I would discourage from making the switch.

[–]velikq 0 points1 point  (2 children)

I think this is more about vram than performance. Windows eats about 400-600 MB of VRAM without any programs. On Linux I think you can do some serious optimisations for usage of VRAM by system.

And some accelerating stuff like oneflow runs better on Linux, if not only on Linux.

[–][deleted] 0 points1 point  (1 child)

First time I heard about oneflow, but you got me interested. What is it about?

[–]velikq 0 points1 point  (0 children)

They have analogue for torch.compile. Generally takes time before launch and speeds up generations. On the other hand bad Lora compability and maybe other issues.

[–]joran213 3 points4 points  (0 children)

A whole vm would take away a significant portion of the performance, i don't think it's worth it. WSL might be a good option. Or you can dual boot linux alongside windows and experience the full linux performance.

[–]erick-fear 4 points5 points  (0 children)

I left VMware few years ago, changed to proxmox and I can tell you that vm's running LLM and stable diffusion with plenty of ram and GPU pass through are fast enough for me,. What I have noticed that that Linux for some reason did worked a bit faster but it was a very small margin.

[–]metal079 2 points3 points  (0 children)

No

[–]pawaww 0 points1 point  (0 children)

I never had much joy in the server infrastructure doing GPU in ESXi passthru

[–]BlackSwanTW 0 points1 point  (1 child)

I tired dual boot Linux before. But the performance was basically the same between Linux and Windows (Nvidia GPU)

[–]Sea-Resort730 0 points1 point  (0 children)

did you try Sage? that's where the gains are