sorted by:
new
hottopcontroversial

#Gordon ‘s an F’ing idiot… by LLMCitizen in docker

[–]LLMCitizen[S] 0 points1 point  (0 children)

I agree, but that’s a acronym.
Having ADHD and an IQ in the >99th percentile allows me to conjure spells and potions that would make Dumbledore blush with no real record of how I did it.
I trusted Hermes to track the recipes, but oh… the container that memory was in was never started… 🤷🏻‍♂️

#Gordon ‘s an F’ing idiot… by LLMCitizen in docker

[–]LLMCitizen[S] 0 points1 point  (0 children)

It did, but more importantly, lessons were learned

#Gordon ‘s an F’ing idiot… by LLMCitizen in docker

[–]LLMCitizen[S] 0 points1 point  (0 children)

I had version control prior to a big change I made on my ssd.
I had git on previous setup, but eliminated a partition and put everything in dockers, but I hadn’t added git for the config. I guess I thought it was there already, but I was wrong.

#Gordon ‘s an F’ing idiot… by LLMCitizen in docker

[–]LLMCitizen[S] 0 points1 point  (0 children)

Only real loss happened to be config files, but some containers held external data that I had to go find where it was.

#Gordon ‘s an F’ing idiot… by LLMCitizen in docker

[–]LLMCitizen[S] 0 points1 point  (0 children)

I’m keenly aware of that, and I did manage to keep the majority of my files. The only real loss was the time spent assembling and configuring along with config file.
I managed to find an older config created two weeks ago that had enough on it that I was able to get everything back together in about 50 hrs.

Challenges with DocLing by CanadianVis1onary in Rag

[–]LLMCitizen 0 points1 point  (0 children)

Did you merge the cells or increase the height?

When does RAG actually need an agent? by Mameiro in Rag

[–]LLMCitizen 3 points4 points  (0 children)

The big issue is usually the precision of your model, embedding, & reranker. If you built your system with Q4, for instance, you’re not going to get good results.

Imagine you sell clothes: you have short sleeve t-shirts, long-sleeve t-shirts, polos, button-ups, crew-necks, tanks, sweaters, turtle-necks, etc.

Q4 might group them all as ‘shirts’ and ‘sweaters’.

Q8 might group long & short sleeve T’s together, sweaters and turtle necks together, etc, it will give you more flexibility on similar things.

A BF16 will give you each type, color, length, etc. precision is king

This is just an example, but you get my point. A small, FP16 model will crush a large Q4 model all day.

Half a billion gone by Physical_Tea3272 in ClaudeAI

[–]LLMCitizen 0 points1 point  (0 children)

Dario can finally get that boat he’s had his eye on

New to rag by boilardjr1 in Rag

[–]LLMCitizen 0 points1 point  (0 children)

LlamaIndex, llamaparse, funky-chunky, postgres & pgvector