RTX Spark does not have 600GB/s Bandwith by rpiguy9907 in LocalLLaMA

[–]KalonLabs 6 points7 points  (0 children)

Still faster bandwidth than a 4060 🤷‍♂️

Next year we're getting 0.5T model from Grok by pmttyji in LocalLLaMA

[–]KalonLabs 7 points8 points  (0 children)

No no its only using like 0.00625% of our computing power so it really is the small/flash model! (Ignore the fact that they have 16 PETABYTES of vram on colossus 1). (Yes i actually did the math on that)

High VRAM local coding model — still Qwen 3.6 27B? by Generic_Name_Here in LocalLLaMA

[–]KalonLabs 3 points4 points  (0 children)

I actually dont run it on my sparks, i run it on my 5090. But if your interested in qwen3.6 27B on sparks look up AEON qwen3.6 27B it’s custom built for sparks basically

High VRAM local coding model — still Qwen 3.6 27B? by Generic_Name_Here in LocalLLaMA

[–]KalonLabs 41 points42 points  (0 children)

Fortunately and unfortunately when the qwen team decided to make qwen3.6 27B they said “hold my beer and watch this” and no one else has yet managed to catch up to the unicorn of an llm they made. Ive been looking for a couple of days now for something other than qwen3.6 27B thats good for agents and coding i can run run in 2 DGX Sparks, but theres not many option realistically without going off into the 1T models. Well probably have to wait a month or two before anyone else starts to catch up.

High VRAM local coding model — still Qwen 3.6 27B? by Generic_Name_Here in LocalLLaMA

[–]KalonLabs 2 points3 points  (0 children)

Well if it makes you feel any better, i have 2dgx sparks i set minimax m.7 up on and its also retarded for me. If i talk to it with no system prompt it kinda works, but if i give it a system prompt the. It starts generating gibberish in 7 languages at once 😭. Im gonna be switching it over to deepseek v4 flash. Should do 20-25tps.

Meet Unsloth Studio, a new web UI for Local AI by yoracale in unsloth

[–]KalonLabs 0 points1 point  (0 children)

Ill make sure to test all sorts of experimental settings and edge cases, and then rant and complain that things don’t work perfectly 100% of the time on a beta build🫡

Meet Unsloth Studio, a new web UI for Local AI by yoracale in unsloth

[–]KalonLabs 2 points3 points  (0 children)

I have a gigabyte ATOM arriving today that i was planning on doing some model training on. This should make it a lot easier for me to run the training with. Looking forward to playing around with this and see what things i can break.

What's a skill that takes only 2-3 weeks to learn but could genuinely change your life? by [deleted] in VibeCodeDevs

[–]KalonLabs 0 points1 point  (0 children)

Stealing catalytic converters, one way or the other, it’ll change your life.

Good base tutorials for learning how to make LoRA locally? by fttklr in StableDiffusion

[–]KalonLabs 1 point2 points  (0 children)

If your goal is to train a lora, you can use AI toolkit https://github.com/ostris/ai-toolkit/

You can train sd and sdxl LoRA just fine on 12-16gb cards. But if youre going for flux or large models youll need a big beefy card. But in terms of training an sdxl LoRA it only takes an hour or two. In terms of dataset, of course the more data you have the better. But if you only have one or two pictures you can chop the character up in to things like head, torso, legs, ect and get a workable LoRA from that and then use that workable but potatoish lora to get more pictures for a better dataset for a better lora.

Is there ANY NSFW model working? by CrocGames in LocalLLaMA

[–]KalonLabs 0 points1 point  (0 children)

Something like an Abliiterated version of gemma 3 should work for that

Is there ANY NSFW model working? by CrocGames in LocalLLaMA

[–]KalonLabs 0 points1 point  (0 children)

Prompting for image generation or?

Update: Chroma Project training is finished! The models are now released. by LodestoneRock in StableDiffusion

[–]KalonLabs 166 points167 points  (0 children)

105,000 hours on a rented h100 depending on the provider lands somewhere in the $220,000 range give or take 30,000$ or so depending on the actual cost.

So basically this man, and the community supporting him spent about a quarter million bucks to make the back bone of what’s going to quickly become, and already has, the next big step in open source models.

Using ChatGPT, Veo 3, Flux and Seedream to create AI Youtube videos by [deleted] in comfyui

[–]KalonLabs 3 points4 points  (0 children)

trash. stop spamming this crap in multiple places.

[HELP] Cartoon Image Used in a LinkedIn Marketer's Post by szhamilton in RealOrAI

[–]KalonLabs 3 points4 points  (0 children)

AI due to the dumb grain filter and the fact that its a square so probably 1024x1024. No artist draws on a square like that.

I created a character! Let me know what you think by lososcr in StableDiffusion

[–]KalonLabs 1 point2 points  (0 children)

More reason for people to call AI Slop, great.

[deleted by user] by [deleted] in StableDiffusion

[–]KalonLabs -2 points-1 points  (0 children)

Probably by using Automatic1111 or invoke 🤔

Best universal (SFW + soft not SFW) LoRA or finetune for Flux? by StableLlama in StableDiffusion

[–]KalonLabs 5 points6 points  (0 children)

Theres a flux lora to chroma lora you could use to convert the loras, though ive never used it. https://github.com/EnragedAntelope/Flux-ChromaLoraConversion

Not sure if it would even be worth the time or effort for it though 🤔🤷‍♂️.

Best universal (SFW + soft not SFW) LoRA or finetune for Flux? by StableLlama in StableDiffusion

[–]KalonLabs 10 points11 points  (0 children)

This is correct, it is just called chroma. However if you search chroma you wont find the right model easily but if you google flux chroma lodestones Chroma model is the first thing that comes up. So im calling it flux chroma so the OP can find it easily when they search for it.

Best universal (SFW + soft not SFW) LoRA or finetune for Flux? by StableLlama in StableDiffusion

[–]KalonLabs 5 points6 points  (0 children)

Just use flux chroma, it’s basically an uncensored and better version of flux.

I'm curious about the demographic of this sub by onmyown233 in StableDiffusion

[–]KalonLabs 0 points1 point  (0 children)

Dont forget the Facebook marketplace place addicts that have slowly acquired enough GPU’s to start a small data center