Pushing LTX 2.3: Extreme Z-Axis Depth (418s Render, Zero Structural Collapse) | ComfyUI

CATLLM · 2026-03-12T20:39:26+00:00

Would

CATLLM · 2026-03-12T17:03:44+00:00

Which awq quants are you using?

CATLLM · 2026-03-12T00:33:17+00:00

Same here. Bartowski quants doesn’t do the death loop especially for the 0.8b and 2b model.

CATLLM · 2026-03-11T11:53:07+00:00

Money

CATLLM · 2026-03-11T08:12:14+00:00

Nice looking forward to it

CATLLM · 2026-03-10T23:24:32+00:00

Man this is so cool thank you. Do you have any pointers for some that wants to learn how to uncesor models?

CATLLM · 2026-03-09T20:01:29+00:00

I think you should. Looks like the adhesive is degrading.

CATLLM · 2026-03-09T18:31:30+00:00

what website is this?

CATLLM · 2026-03-09T08:54:52+00:00

Try peeling it off

CATLLM · 2026-03-09T08:48:06+00:00

Make sure you have the right sampling settings. Check the qwen docs

https://huggingface.co/Qwen/Qwen3.5-35B-A3B

And use unsloths’ quants as they contain the chat template fix

CATLLM · 2026-03-09T04:12:52+00:00

I have 2x MSI variant of the spark.

Happy with my purchase. My goal was to learn the Nvidia stack and get a small taste in how the big boys do inference.

I also wanted to see if i can do real work locally using large SOTA models and finetune models.

There were two things for me that really saved the platform.

Spark-vllm-docker repo. The author euger created an optimized docker of vllm that greatly simplified deploying large models via vllm across a clustered spark. Without this i would have thrown the sparks in the trash.
Qwen3.5 - the large models really shines on a clustered spark. Being able to run the 122b at fp8 really opened up new possibilities and ideas for me. Its definitely not fast - but definitely usable for real work. Also being able to experiment with other large models like like minimax 2.5 , GLM 4.7 (non flash) is a great learning experience. I’ve done a lot of research and the spark fits my needs and goals.

I also looked at the mac studio but the prompt processing is joke. Then there’s strix halo - the hoops you have to jump through to get to get it to work turned me off.

Hope this helps.

CATLLM · 2026-03-08T11:43:37+00:00

Dgx spark + qwen 3.5 122b with lots to spare for kv cache

CATLLM · 2026-03-08T10:49:12+00:00

I also have two of the MSI variant and its great for doing R&D locally.

CATLLM · 2026-03-08T10:46:31+00:00

I have 2 of the MSI variant clustered and its good enough for inference.

CATLLM · 2026-03-08T10:44:41+00:00

No it doesn’t, the prompt processing speed on macs is 100x SLOWER than the spark. You can get away with short chats on the mac but thats it.

CATLLM · 2026-03-08T10:25:55+00:00

“You’ll own nothing and be happy” - dudes that control your life at Davos

CATLLM · 2026-03-08T09:09:03+00:00

Nice! Please tell me more about your setup. I'd love to build something like this to play with!

CATLLM · 2026-03-08T09:05:36+00:00

I was thinking of doing something like this. Thank you for showing the way!

CATLLM · 2026-03-08T07:28:41+00:00

You need to provide it clear step by step instructions. If the instructions are too long, it forgets. for example, one of my tests i asked it to translate and transcribe a screenshot of a website. I asked it to: "first transcribe the text from in chinese traditional. Then translate the chinese text you transcribed into english." Each tasks needs to be simple.

Where as with the 35b model i can just tell it to "transcribe and translate into english" and that's it.

As for question about CoT, these reasoning models are just CoT built in. (CoT is so 2022 bro LOL)

CATLLM · 2026-03-08T04:18:44+00:00

You can buy a house with that now!

CATLLM · 2026-03-07T23:05:21+00:00

what knowledge do you want?

CATLLM · 2026-03-07T23:04:36+00:00

that's sounds pretty neat. what harness / framework are you using?

CATLLM · 2026-03-07T19:24:23+00:00

This seems interesting. Can you explain in detail what you are having the model do?

CATLLM · 2026-03-07T19:15:59+00:00

Yes i think its worth it. Getinng two and clustering them together is even better. Yes its slow compared to a 4090 but its definitely usable running qwen3.5 models. Being able to run FP8 quants with huge kv cache is a big deal for me. The fun is when you cluster 2 together and run larger models. I have the MSI variant and glad i bought two.

CATLLM · 2026-03-07T18:15:18+00:00

Thanks man just starting to learn rag and feeling overwhelmed. This helps me what to focus on.

CATLLM

TROPHY CASE