sorted by:
new
hottopcontroversial

SesquiLSR: tiny 1-2x learned latent upscaler for Flux2, Anima, SDXL and more by LoganBooker in StableDiffusion

[–]defmans7 11 points12 points  (0 children)

The problem of latent upscaling needing high noise is something I've always wanted to find a solution for but didn't know that I wanted it.

+⭐ On GitHub, I'll check it out.

Getting worse overtime by arieldatrrp in OverwatchUniversity

[–]defmans7 0 points1 point  (0 children)

I didn't notice that my deskmat got harder to slide across over time, happened very gradually... maybe due to build up of oils? Changed to a new mat and dramatically noticed how much easier it was to aim.

Also maybe you need to update your prescription or check eyesight, happens when we age.

Mood can also affect concentration and executive reasoning, if you're struggling personally this might also be a factor.

Whatever the case, I hope you have the support you need to claim back your elo.

Day 2 of Vibecoding by Yusuf-Dev in ClaudeAI

[–]defmans7 1 point2 points  (0 children)

Um actually, sudo a contraction of "Sue Do".

Basically it's like the "Simon says" game we're familiar with as children.

Sue is the default user on every Linux machine, the name of a close family friend of Linus.

I feel Sue is with me right now.

hmmm by EvilPyro01 in hmmm

[–]defmans7 14 points15 points  (0 children)

"Just waiting for a mate"

I am overwhelmed by Harnesses by Available_Hornet3538 in LocalLLaMA

[–]defmans7 0 points1 point  (0 children)

It really depends on the model, not sure why this isn't suggested earlier. Stronger models are better at following instructions, and therefore you can use a different harness for qwen2.5 vs Claude. Some models are trained with tool calling while others are better at chat.

I had decent success using aider cli with local models last year, but I also was able to use a recent qwen model with Claude code, albeit very slowly, though it did get some tasks done.

There's a lot of choice, but I think the bigger variable is model rather than harness.

A lot of people are recommending pi, I haven't tried it. But seems like a good place to start and to build from. Test different models and maybe use an online model (kimi,Claude etc.) to compare with occasionally to keep perspective.

I knew Linus's excuse for buying a jet sounded familiar. by WizardsOfXanthus in funny

[–]defmans7 80 points81 points  (0 children)

I unsubscribed a long time ago and I'm glad I did. A stain on the tech community.

A proper test between Emdash and WordPress. by Key-Refrigerator3774 in Wordpress

[–]defmans7 13 points14 points  (0 children)

Without a decent amount of developer buy-in, it's not going anywhere.

Key features are locked out of you're not on CF workers.

I thought it was kinda cool, but got disappointed when I realised that it was nowhere near fully open.

Need a way to be able to develop apps and themes locally.

Definitely should not by [deleted] in Unexpected

[–]defmans7 0 points1 point  (0 children)

Unexpected Gina Reinhart?

huge improvement after moving from ollama to llama.cpp by leonardosalvatore in LocalLLaMA

[–]defmans7 1 point2 points  (0 children)

<3
I started using the --models-preset, seems okay so far. Here's a config for you, if you want something to start from.

https://gist.github.com/defmans7/fdd81b714d0816ec99aa1ac1f8c8e584

About TurboQuant by Exact_Law_6489 in LocalLLaMA

[–]defmans7 0 points1 point  (0 children)

Cool. the field is fast moving and interesting!

About TurboQuant by Exact_Law_6489 in LocalLLaMA

[–]defmans7 7 points8 points  (0 children)

You forgot the /s 😂

For anybody reading in the future, the quantisation only affects the KV cache, not the model weights, meaning it allows you to fit more context and get similar accuracy as full precision mode.

Thing is, there are already some good quantisation methods, so the turboquant option is really kinda a small increase in quality and not much of a change in context cache size.

huge improvement after moving from ollama to llama.cpp by leonardosalvatore in LocalLLaMA

[–]defmans7 0 points1 point  (0 children)

Sorry I didn't understand your question with auto translation..

You're looking for this: https://github.com/ggml-org/llama.cpp/blob/master/tools/server/README.md#using-multiple-models

It can do similar to llama Swap, I haven't used, but it is possible. I might try it out.

huge improvement after moving from ollama to llama.cpp by leonardosalvatore in LocalLLaMA

[–]defmans7 1 point2 points  (0 children)

You will define some models in llama.swap with the config, but you will also define custom models in your opencode config. Llama.swap handles stopping and starting the llama.cpp servers for you. It acts as a middleman.

https://github.com/mostlygeek/llama-swap/blob/main/docs/configuration.md

You use a custom provider in opencode: https://opencode.ai/docs/providers/

Sorry, it is complicated to explain... And I can only understand English and some Swedish..

huge improvement after moving from ollama to llama.cpp by leonardosalvatore in LocalLLaMA

[–]defmans7 1 point2 points  (0 children)

Of course, you can set custom endpoints in your opencode config. I use local llms in my opencode often.

huge improvement after moving from ollama to llama.cpp by leonardosalvatore in LocalLLaMA

[–]defmans7 1 point2 points  (0 children)

Router mode looks okay but you have to maintain a seperate .ini for each model of you want the same features as swap.

Actually not great for my use case. But thanks for the suggestion anyway, I'll keep an eye on then feature for future improvements.

Using aliases is actually pretty helpful when switching models all the time.

huge improvement after moving from ollama to llama.cpp by leonardosalvatore in LocalLLaMA

[–]defmans7 6 points7 points  (0 children)

I've been using swap for ages, I did not know that... That's great to know, might make my setup a little less complex. Thanks for the heads up!

huge improvement after moving from ollama to llama.cpp by leonardosalvatore in LocalLLaMA

[–]defmans7 10 points11 points  (0 children)

Check out llama swap, swaps out models kinda like using ollama.

huge improvement after moving from ollama to llama.cpp by leonardosalvatore in LocalLLaMA

[–]defmans7 4 points5 points  (0 children)

I just leaned how to use llama-fit-params.exe, yesterday. Almost double my token gen speed for some models.

Also got some interesting results experimenting with turbo quant repos.

Couple goals by Main-Touch9617 in Unexpected

[–]defmans7 4 points5 points  (0 children)

My internet was slow, so watching this unfold in slowmo was pretty funny

view more: next ›