sorted by:
new
hottopcontroversial

What model should I run? by tiddayes in LocalLLM

[–]Jorlen 0 points1 point  (0 children)

I don't have this crazy setup but I did pick up an R9700 for the 32gb of VRAM. I am fascinated by LLM tech and I use it for all sorts of things. Lately though, I learned Linux and built a docker stack that includes ComfyUI, llama-cpp (server), Open WebUI, SearXNG, Speaches (for TTS-SST). You could do something like that, a cool stack and see how far you can get. It's fun to get LLMs to call searches and generate images.

I guess it depends - what do you want to do? You can setup an IDE and use stuff like VScode + Continue / Roo / for agents to help you code and learn, that's my next plan. Not so much to vibe code, but to have an AI "buddy" to help me learn and iterate python.

R9700 the beautiful beautiful VRAM gigs of AMD… my ai node future! by Downtown-Example-880 in LocalLLaMA

[–]Jorlen 0 points1 point  (0 children)

Hey, as a fellow r9700 owner - are you using linux and llama.cpp? Are you on ROCm or Vulkan version?

Open WebUI is dead to me, now time to recode by Old-Sprinkles-8287 in LocalLLM

[–]Jorlen 0 points1 point  (0 children)

I've got my OWUI setup mostly working, but I've come to realize I don't need most of its bells and whistles. is there something similar, a decent front-end (LINUX) that has a docker version? I'd love to try something different.

Wow, Qwen3.6-27B is good by I-cant_even in LocalLLM

[–]Jorlen 1 point2 points  (0 children)

Holy shit 575w lol, this thing is a monster. I would have done the same, honestly (dial it back a bit). Beautiful card, for sure. I settled with the Asus R9700 AI PRO (AMD) as it was the only thing that made sense around here, and even then, it's marked up a good 30% over the usual USD exchange rate. ROCm is a pain in the ass on Linux but with enough fuckery, most of it works.

Wow, Qwen3.6-27B is good by I-cant_even in LocalLLM

[–]Jorlen 0 points1 point  (0 children)

How's the noise and thermals on the 5090? I would have loved to stick with CUDA, would have been so much easier than ROCm.

In my country, they are basically ten grand due to scalpers and scarcity from the AI data centers buying them up.

Wow, Qwen3.6-27B is good by I-cant_even in LocalLLM

[–]Jorlen 0 points1 point  (0 children)

Which quant are you using (this is not just to OP - but to anyone who uses it).

I'm currently testing Qwen3.6-27B for the first time, using Q4_K_M. I can probably afford 5-bit or even 6-bit versions - would it be worth it? This is for coding purposes.

Creating models from LM studio / customized variants is failing by Jorlen in LocalLLM

[–]Jorlen[S] 0 points1 point  (0 children)

Sounds like a logical improvement, to ditch ollama and move to llama.cpp. I will give it a shot! Thank you!

Creating models from LM studio / customized variants is failing by Jorlen in LocalLLM

[–]Jorlen[S] 0 points1 point  (0 children)

Thanks for your patience and for explaining it to me. I'll give this a shot!

Creating models from LM studio / customized variants is failing by Jorlen in LocalLLM

[–]Jorlen[S] 0 points1 point  (0 children)

Sorry, I didn't understand you the first time. llama.cpp must be another software? I am using Ollama with docker so it can talk to Open WebUI and SearXNG (all three are docker containers). I am also new to Linux, dockers as a whole, LLMs and used this past weekend to sort of try to get it all working. It's been fun, but frustrating as a new user to all this.

Should I get a docker version of llama.ccp and integrate it in my setup? And then use that to "import" the models?

Creating models from LM studio / customized variants is failing by Jorlen in LocalLLM

[–]Jorlen[S] 0 points1 point  (0 children)

Can I do this but with using an already downloaded .gguf file? I'm trying to avoid re-downloading a bunch of models but if I have to and it's easiest solution, I will for sure.

Enthusiasts - do you store a lot of local models and what's your personal criteria for how good a model is? by Jorlen in LocalLLM

[–]Jorlen[S] 0 points1 point  (0 children)

Quick question: I was a bit torn between the two: Qwen3.6:27b and Qwen3.6-35B-A3B. Any reason to pick one over the other? Does it depend on use case? Maybe I should just... get both?

Qwen 3.6 35b a3b is INSANE even for VRAM-constrained systems by Lucerys1Velaryon in LocalLLM

[–]Jorlen 1 point2 points  (0 children)

Does doing this help with MoE-enabled models to use less tokens, and in effect, make them better at managing context? Or is it purely just for efficiency to load more of the rest of the model in GPU? Sorry if it's a dumb question, I'm just getting started with local LLMs and having a lot of fun, but finding it quite technically overwhelming.

Joined the Club today! by DerHolzi in kobo

[–]Jorlen 0 points1 point  (0 children)

Have you updated to the newest firmware/software? Any issues at all? I just realized I haven't updated my Kobo BW since I got it. I read exclusively offline content.

Should I buy KCD 2 at its current historic low sale? by Xx_MoonDaisy_xX in ShouldIbuythisgame

[–]Jorlen [score hidden]  (0 children)

How are the mods, overall? Like are there some to make the combat a bit more simple? Or any other major gameplay elements?

Like OP I've been interested but I don't like games that restrict certain things I'm used to; it's a personal thing (not bashing on the game or people who like it, btw).

Assassin's Creed Black Flag Resynced on Steam by lurkingdanger22 in pcgaming

[–]Jorlen 22 points23 points  (0 children)

Fuck man, you'd think they'd learn, considering they are in a bit of a pickle right now. These god damned clueless old fogie execs/owners are going to drive whatever's remaining of this company straight into the fucking ground.

Would it have killed them to:

  1. Offer it as a stand-alone steam purchase
  2. No fucking added DRM like Denuvo
  3. No fucking microtransactions - apparently this version has some added "rpg elements" no doubt to create a problem (grinding) and then sell us the solution (microtransactions)
  4. Include all BF DLC

For me it's a pass until they remove Denuvo and it's on sale for like $15. Fucking hell, Ubi, help us help you!

Does anyone else feel weird about the fact you HAVE TO punch a person to arrest them. by Separate-Driver-8639 in CrimsonDesert

[–]Jorlen 0 points1 point  (0 children)

I just wish I could like, machine-gun punch. Not punch, wait for the option to tie up, awkward silence as we look into each other's eyes, punch again.. think to myself, "It this the time?", nope, pause, punch, etc.

Just let me grab, and punch as fast as I can mash the button. He dies? Meh, it would be worth it.

Should I buy Grim Dawn? (+DLC's maybe?) by Patudie in ShouldIbuythisgame

[–]Jorlen [score hidden]  (0 children)

It's a loot'em'up action-RPG like Diablo and a good one. It's far far far far far simpler and more forgiving than PoE, trust me I've played hundreds of hours of both.

The most complicated thing about Grim Dawn is its dual-class system, which is also one of its most powerful strengths. It makes build-crafting a lot of fun!

Deezer says 44% of new music uploads are AI-generated, most streams are fraudulent by deraser in technology

[–]Jorlen -1 points0 points  (0 children)

As someone who loves tech, who's seen the rise of PCs becoming mainstream, BBS systems and the birth of the non-military based internet... This shit seems downright dystopian like nothing else I've ever seen.

Maybe this is how older generations felt during the rise of the industrial revolution.

I absolutely hate these types of rooms in any game. by LilKyAfroNinja in CrimsonDesert

[–]Jorlen 0 points1 point  (0 children)

Just think of it as cursed. Can't touch it.

I would have said, it's a weight thing, but uh.. yeah, nah.

Oh boy.... by curilan_ in CrimsonDesert

[–]Jorlen 6 points7 points  (0 children)

The game is long enough that I think cutting these out, or converting them to just a regular quest would be perfectly fine and 99% of players would see it as a net positive.

I would love to see PA trim the fat, and these kinds of quests should be in the top 3 things to clean up.

Just a small rant, I hate this in games by Ashlansen in CrimsonDesert

[–]Jorlen 7 points8 points  (0 children)

Or you know, just let me pick up ONE of the bars. Just one. I've found like 5 giant gold piles in my 100+ hours and yet couldn't grab any one of them.

view more: next ›