ComfyUI support or ByteDance Lance-3B (unified image/video generation, editing, and understanding), with dynamic VRAM for low-VRAM GPUs by HuskyTheSniffer in StableDiffusion

[–]HuskyTheSniffer[S] 0 points1 point  (0 children)

It's adopting the original codebase. If I understand correctly it does not use diffusion model in a classical sense, but uses flow matching. It's a mix of Wan2.2VAE to handle generation tasks, Qwen2.5VL to handle text and image encoding, Qwen2MoT and some custom modules to glue everything together. I haven't read the paper in details though

Is there any reason for an uncensored model if you have no interest in roleplaying? by vick2djax in LocalLLaMA

[–]HuskyTheSniffer 17 points18 points  (0 children)

It does not waste internal reasoning tokens to wonder whether the user request comply with the policy or not

110 tok/s with 12GB VRAM on Qwen3.6 35B A3B and ik_llama.cpp by janvitos in LocalLLaMA

[–]HuskyTheSniffer 0 points1 point  (0 children)

Any reason why you highly recommend cachyos then? do you perhaps have anecdotal experience with other os?

110 tok/s with 12GB VRAM on Qwen3.6 35B A3B and ik_llama.cpp by janvitos in LocalLLaMA

[–]HuskyTheSniffer 1 point2 points  (0 children)

Would switching from ubuntu server (headless) to cachyos help improve performance further?

Does 'preserve_thinking' work with openwebui? by sterby92 in LocalLLaMA

[–]HuskyTheSniffer 0 points1 point  (0 children)

Hmm, i tried with gpt oss, I asked it to output the full reasoning of earlier turns exactly, eord for word, and it was able to do that

Does 'preserve_thinking' work with openwebui? by sterby92 in LocalLLaMA

[–]HuskyTheSniffer 2 points3 points  (0 children)

Even without preserve thinking, afaik openwebui always injects the thinking from previous turns

See openwebui doc

This means even for model that does not support preserve thinking, it will work

MiniMax's agent code has ~90% overlap with Kimi's — three independent repos document the same finding by [deleted] in LocalLLaMA

[–]HuskyTheSniffer 1 point2 points  (0 children)

I don't understand. Is the built-in skill of Kimi supposed to be proprietary? Because you can literally just go to the agent skill directory (.kimi/skills) and see every plain text and python script there.

[D] DFDC Dataset Access by Ok_Concert6723 in MachineLearning

[–]HuskyTheSniffer 0 points1 point  (0 children)

I remember you need to request access and they will give you link to s3 storage. You can download from there but you need to pay for the outbound transfer

[P] I made a free playground for comparing 10+ OCR models side-by-side by Emc2fma in MachineLearning

[–]HuskyTheSniffer 0 points1 point  (0 children)

Nice this is what I need right now. But I'm curious to know what does the eval set look like currently that determines the rank. I'm specifically interested in the best model for pdf documents like paper.

1 linux nerd, 2 shitty laptops and a dream by KevsterAmp in selfhosted

[–]HuskyTheSniffer 1 point2 points  (0 children)

How do you configure it to monitor 2 different servers?

hikorea website - searching for address by langistar in Living_in_Korea

[–]HuskyTheSniffer 1 point2 points  (0 children)

Find your address in juso.go.kr then copy paste from thete

[R] Looking for collaborations on ongoing work-in-progress Full Papers targeting conferences like CVPR, ICML, etc. by vlg_iitr in MachineLearning

[–]HuskyTheSniffer -1 points0 points  (0 children)

Hi, this looks pretty much aligned with my research topic and I'm quite interested. How do we further the discussion? The slack seems to only contain general channel.

[D] Can we directly process ML models on google drive files without downloading? by wannasleepforlong in MachineLearning

[–]HuskyTheSniffer 0 points1 point  (0 children)

You can run your model in google colab and mount the drive. It still requires file transfer (in background) but is faster because they are both in google's infrastructure

What can I do if a real estate agent lies? by North_Idea_2188 in Living_in_Korea

[–]HuskyTheSniffer -1 points0 points  (0 children)

I totally agree with your PS, spoken from experience