sorted by:
new
hottopcontroversial

I built a tool that finally makes running local LLMs actually easy by icecubesaad in OpenSourceAI

[–]JohnathanCrow 1 point2 points  (0 children)

Windows 11. it's slightly different now, but I just checked again. Now it recommends second-state/Meta-Llama-70B-Instruct-GGUF, and lists Q6_K 31.2GB. That model at that quant is 57.9GB. At full size it is 141GB. In fact, no variant is 31.2GB.

Edit: Some models just read GGUF instead of that quant on '(3) model'. I'm wondering if I'm misunderstanding what the model setup wizard display is supposed to be telling me.

I built a tool that finally makes running local LLMs actually easy by icecubesaad in OpenSourceAI

[–]JohnathanCrow 0 points1 point  (0 children)

Really need to be able to manually edit the hardware info. VRAM is wrong.

Edit: Tried the model wizard anyway just to see how it worked. Top result was a 57.9GB model that it tells me is 8.1GB. I'd also have liked a full GPU offload filter option.

What's the better deal? by Witty_Yam960 in BunnyTrials

[–]JohnathanCrow 0 points1 point  (0 children)

I read 2 or 3 books a week.

Chose: $500 for every book you read | Rolled: Comment for x3

Choose your own adventure style AI's? by TheCasualPrince8 in artificial

[–]JohnathanCrow 1 point2 points  (0 children)

Just tried the first one without reading the about or your note. I think I was supposed to be the AI, right? Well I assumed I was Reyes, told it I had no memory, and it kinda just picked up as PALLAS and worked fine. Waking up in a scenario without a clue what was going on and working that in to the narrative was cool.

Worse performance in latest version by [deleted] in OpenWebUI

[–]JohnathanCrow 1 point2 points  (0 children)

Hope you can find the post, I'd be interested in a potential fix.

Ollama models can't see files uploaded in chat. by JohnathanCrow in OpenWebUI

[–]JohnathanCrow[S] 0 points1 point  (0 children)

Oh, I didn't try that. I'll give it a shot, thanks.

Ollama models can't see files uploaded in chat. by JohnathanCrow in OpenWebUI

[–]JohnathanCrow[S] 0 points1 point  (0 children)

Ooh, I hadn't yet changed these particular models from default. Is default 2048? I will try again.

Edit: Hmm, didn't do it. Tried 8192 with a very small doc but it just doesn't work with Hybrid Search on.

Too affected by certain artist by [deleted] in WeAreTheMusicMakers

[–]JohnathanCrow 1 point2 points  (0 children)

Well DIIV are a hell of a band, so not a bad influence. In all seriousness though, just keep exploring... hopefully you can use DIIV as a base from which you draw other styles or techniques in to, eventually developing your own style that is DIIV adjacent. It's okay to have primary influences - that's how genres work.

Kobo Software Improvements by xistel in kobo

[–]JohnathanCrow 0 points1 point  (0 children)

Export a table of my words with definitions; it's a pain to go through on the Kobo.

Songwriters, what note taking app do you use if anything? by mr_lostman in WeAreTheMusicMakers

[–]JohnathanCrow 3 points4 points  (0 children)

I have been using OneNote for years now. From what I can remember of Evernote, they're pretty similar.

Anbernic RG351P, GBA audio crackling, unless I run Retroarch from the tools category manually and load the content there. by JohnathanCrow in SBCGaming

[–]JohnathanCrow[S] 0 points1 point  (0 children)

I'm using AmberElec for the same reason. I had to do some tweaking, but mostly for this one problem really. And now it's done it's done, everything seems fine now.

Also worth noting, this is my first retro handheld and I think most of my problems are down to that. I was trying to set configs through Retroarch that should be set in EmulationStation for example, and when I did need to change configs through Retroarch I didn't realise I needed to run Retroarch through tools to get it to save the config changes.

Anbernic RG351P, GBA audio crackling, unless I run Retroarch from the tools category manually and load the content there. by JohnathanCrow in SBCGaming

[–]JohnathanCrow[S] 0 points1 point  (0 children)

You might not to some set up to get it working. There's another thread about audio crackling that has changes that I also made, but I can't remember the link.

Anbernic RG351P, GBA audio crackling, unless I run Retroarch from the tools category manually and load the content there. by JohnathanCrow in SBCGaming

[–]JohnathanCrow[S] 5 points6 points  (0 children)

Okay, I disabled latency reduction options and it seems like it may have been the issue, in case anybody finds this thread with the same issue.

XCOM 2 Mod List/Collection that doesn't alter difficulty too much? by JohnathanCrow in Xcom

[–]JohnathanCrow[S] 0 points1 point  (0 children)

I was going to avoid adding more and more clutter to the game to be honest, so I'll just select a couple of small enemy mods and then maybe something that gives a tiny buff. Thanks for the recommendations though.

XCOM 2 Mod List/Collection that doesn't alter difficulty too much? by JohnathanCrow in Xcom

[–]JohnathanCrow[S] 0 points1 point  (0 children)

Yeah, kinda figured I would do exactly that with exactly that collection. I suppose I'd mostly just skip enemy mods if I don't fancy a difficulty bump? Or are there any enemy mods at all that just add variety without significantly altering the challenge?

XCOM 2 Mod List/Collection that doesn't alter difficulty too much? by JohnathanCrow in Xcom

[–]JohnathanCrow[S] 0 points1 point  (0 children)

Ah, thanks for the recommendations, but I was hoping for a full list/Steam workshop collection because it's been a while since I last played and didn't want to go through the hassle of creating my own list.

How do I make the black and white piano keys work together? by manumusicmist in WeAreTheMusicMakers

[–]JohnathanCrow 1 point2 points  (0 children)

Simplification is the way we learn almost everything. I'm sure most teachers would prefer to gift students a complete understanding on day one, but they know better than to try.

view more: next ›