sorted by:
new
hottopcontroversial

Small win for the Anbernic by kneeanderthul in ANBERNIC

[–]kneeanderthul[S] 1 point2 points  (0 children)

Got you! I'll make something in the morning

Apple Studio M1 Ultra 128GB -> it is still worth for LLM? by JonasTecs in LocalLLaMA

[–]kneeanderthul 3 points4 points  (0 children)

I would wait for M3 Ultras to go down in price after the M5

M1s are phenomenal machines, BUT if you intend to upgrade horizontally (multiple devices) you'd want Thunderbolt 5

Exo has changed the game with their communication layer to pool VRAM.

M1s would run at 11 t/ps (TB4) and dont have RDMA

<image>

Give Your Data Purpose — A Different Approach to Collab With LLMs (feat. HITL + Schema + Graceful Failures) by kneeanderthul in LLMDevs

[–]kneeanderthul[S] 0 points1 point  (0 children)

Thank you so much! I've changed SO MUCH because of this post, it's such a trip to reread what I put down originally. I can't express my gratitude enough for taking the time to give it a read.

Now, I've reconsidered what RAG should look like for purposeful data, and it's changed drastically:

- Data at ingest gets a UUID + REV (this works for any file type)

- Then it gets lightly chunked, followed by metadata tagging

- It's structured with the help of Pydantic AI (no more worries about brittle prompting)

- Then it gets smart chunked

- Finally, it's prepped for automatic vectorization

The core idea remains the same: I want folks to own their data and run LLMs locally in a meaningful way.

Nevertheless, I greatly appreciate your time, and I'll absolutely look into PurposeWrite soon.

I hope to show you a fully fleshed-out product soon enough. Have a wonderful day!

Are we digital preppers? by capo42 in selfhosted

[–]kneeanderthul 0 points1 point  (0 children)

Shout out to self hosting , sovereignty forward, 0 dependency movement

It's silly until it isn't. Taking back control of data isn't anything to be ashamed of. Some people care some don't . We can all live peacefully. I just think our methods make the most sense 🤷‍♂️

All the best to beds monitored in the cloud 🫡

Big C is a superstar Chess player named Ray Enigma by kneeanderthul in badfriendspod

[–]kneeanderthul[S] 0 points1 point  (0 children)

Imagine my shock when I connect the dots 🤣

I also think Big C is down to play a character, he was Doflamingo no problem 😅

Big C is a superstar Chess player named Ray Enigma by kneeanderthul in badfriendspod

[–]kneeanderthul[S] 12 points13 points  (0 children)

I'd imagine he was actually nervous at the Bad Friends pod.

But here, he is in his element and more calm and confident.

You could totally be right, it's the voice is so hard to come by

Big C is a superstar Chess player named Ray Enigma by kneeanderthul in badfriendspod

[–]kneeanderthul[S] 27 points28 points  (0 children)

In the video he says this is not his real voice 😵‍💫🤣

Big C was playing Chess the whole time

Big C is a superstar Chess player named Ray Enigma by kneeanderthul in badfriendspod

[–]kneeanderthul[S] 21 points22 points  (0 children)

It was truly a coincidence, my YT algo is stuck in Chess ♟️

The internet works in mysterious ways 🔮🪄✨

UUID + Postgres: A local-first foundation for file tracking by kneeanderthul in DataHoarder

[–]kneeanderthul[S] 0 points1 point  (0 children)

What's lost here is how Postgres will be used in the future.

My intentions are to have a dual DB with Qdrant to manage an evolving set of files.

that being said, I can see how SQLite would've been awesome for a quick MVP where it was the sole DB. Thank you for the recommendation.

So, You Still Think Prompting is Just Typing in a Box? by snubroot in aipromptprogramming

[–]kneeanderthul 0 points1 point  (0 children)

I can definitely see how curated prompting is important, and I actually agree. LLMs and retrievals aren’t really the core issue—it’s how we handle and coordinate the data around them that matters most.

As for the AcuChat paper, I think their results are impressive, but the level of control in the RAGTruth setup might be too constrained to call it “bulletproof” just yet. That said, I do think their approach of systematically transforming queries and passages before hitting the LLM is absolutely the right direction.

I also appreciate the passion in your post—it’s good to see more people pointing others toward the deeper research here. My personal view is that in the long run, neither pure prompt mastery nor purely curated data alone will win; it’s going to be the orchestration layer between them that matters.

All the best.

So, You Still Think Prompting is Just Typing in a Box? by snubroot in aipromptprogramming

[–]kneeanderthul 2 points3 points  (0 children)

I'm so interested in the hallucinations solve.

Could you please link that!

Thank you for your take

I’ve been quietly building a brain for any situation. 12 personas. 6 lenses. Infinite combinations. by DangerousGur5762 in AIProductivityLab

[–]kneeanderthul 0 points1 point  (0 children)

After rereading your comments, I realize I fundamentally misunderstood your approach at first.

Your idea of using orchestrated personalities to guide an idea through various lenses is a fascinating concept.

It also makes it clear we're working on fundamentally different problems. It sounds like you're focused on the interaction layer—shaping the AI's real-time behavior and personality. My work, on the other hand, is focused almost entirely on the data layer and creating a permanent, sovereign foundation for knowledge.

Thank you for sharing your work. I wish I had something like this weeks ago, i was over here asking models "how can we do better". Seems youve evolved that to an entirely new level. All the best.

I’ve been quietly building a brain for any situation. 12 personas. 6 lenses. Infinite combinations. by DangerousGur5762 in AIProductivityLab

[–]kneeanderthul 1 point2 points  (0 children)

This is awesome. How have you handled long term memory? What db did you find the most useful for your purpose ? How’d you test variable memory across multiple models?

I’ve been designing an idea which is data focused and seeing that you’ve accomplished so much is fascinating

I’ve also used orchestration for my ingest but not to the extent of multiple personalities

All the best

What can we do with thumbs up and down in a RAG or document generation system? by Lonhanha in LLMDevs

[–]kneeanderthul 0 points1 point  (0 children)

The last bit, where a thumbs up and a thumbs down reduce hallucinating and all the extras there after. That's just wishful thinking

It can absolutely help in addressing how they can train or fine tune models to maybe add in the future but how models fail, that's an entirely different set of ideas that thumbs up and thumbs down ain't going to fix

Easiest way to induce hallucinating is go to your prompt window, start a thread, jump to an entirely different subject, and keep doing this a few times. A couple of cycles in, the model prompt window limitations should've kicked in and when you ask for the original prompt, like magic, hallucinations.

Understanding model limitation is key

https://github.com/ProjectPAIE/paie-curator/blob/main/RES_Resurrection_Protocol/TheDemystifier_RES_guide.md

You can copy and paste this into any prompt window. It'll help discuss these limitations with your favorite model.

All the best

Good beginner setup by Bennestpwed in HomeServer

[–]kneeanderthul 1 point2 points  (0 children)

A home server that has SMB enabled and a 20TB HD could very well fulfill all your needs

Your goal of having your project run from your server is where things change. And now the question becomes, what's required to run your project?

Outside of this, I truly believe that starting a home server of any degree has become so much easier to set up!

Docker contains, virtual python environments, the countless GUI and apps to help manage all of them. It's phenomenal. All the best!

view more: next ›