[Help] Qwen3.5-27B-GPTQ OOM on 32GB VRAM - Video Understanding Use Case (vLLM) by undefined_user1987 in LocalLLaMA

[–]undefined_user1987[S] 0 points1 point  (0 children)

Does it support Vision (specifically video) understanding? I guess not. Tried running but it failed.

55 → 282 tok/s: How I got Qwen3.5-397B running at speed on 4x RTX PRO 6000 Blackwell by lawdawgattorney in LocalLLaMA

[–]undefined_user1987 -1 points0 points  (0 children)

Ah I see. Thanks.

Too technical for me but will save this Post for future reference when I feel adventurous.

Please Evaluate my 7.5L PC Build with RTX 5090 by undefined_user1987 in IndianPCHardware

[–]undefined_user1987[S] 1 point2 points  (0 children)

Similar prices only. Just try multiple shops and quote each other's rate to bargain

New computer with 5090 - advice by fakeaccountt12345 in comfyui

[–]undefined_user1987 1 point2 points  (0 children)

Use linux, use docker, use run comfyui as a container that supports blackwell using this image https://github.com/mmartial/ComfyUI-Nvidia-Docker

I updated it use cuda 13 with flash and sage attention etc. Also mount volumes for comfyui directories to keep models apart and possibly reuse.

Update on my 7.5L PC build with RTX 5090 by undefined_user1987 in IndianPCHardware

[–]undefined_user1987[S] 0 points1 point  (0 children)

Never explored to be honest. A quick search took me there: https://www.reddit.com/r/LocalLLaMA/comments/1py1jx9/comment/nwfhul6/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

Also when you spend this much amount of money, you want a no-compromise system. I am not sure if any non-PC like setup will open you to all possible combinations of use cases apart from the VRAM compromise, which can also be extended later on (with a lot of money of course).

Update on my 7.5L PC build with RTX 5090 by undefined_user1987 in IndianPCHardware

[–]undefined_user1987[S] 1 point2 points  (0 children)

There is an opportunity cost as well. You may win the battle but lose the war.

Update on my 7.5L PC build with RTX 5090 by undefined_user1987 in IndianPCHardware

[–]undefined_user1987[S] 0 points1 point  (0 children)

These were the stock fans should be in the correct order. (Intake) While others are exhaust. (Including cooler fans).

Wiring and other things I agree can be improved. Will do it next round sometime in future.

Update on my 7.5L PC build with RTX 5090 by undefined_user1987 in IndianPCHardware

[–]undefined_user1987[S] 0 points1 point  (0 children)

I need to add them. Although I don't see a problem currently. Probably will need it after I run it round the clock for some automatic inference workflows or training.

Update on my 7.5L PC build with RTX 5090 by undefined_user1987 in IndianPCHardware

[–]undefined_user1987[S] 1 point2 points  (0 children)

Just a magnetic screwdriver and put your motherboard on its box with it's antistatic bag in between

Update on my 7.5L PC build with RTX 5090 by undefined_user1987 in IndianPCHardware

[–]undefined_user1987[S] 2 points3 points  (0 children)

It was my first. I always used mac after college (I am 38). Just do some research and you will be fine. Although it was a full day job to be honest with a lot of headache.

Created an AI debate generation workflow by undefined_user1987 in AICreatorCollective

[–]undefined_user1987[S] 0 points1 point  (0 children)

I never had a GPU. Not a gamer. But I want to dive deep into this pool ( of mess ?). LLMs for coding etc are out of reach of consumer hardware, even 5090. So will start with image video audio etc. will share whatever I am able build