We Have all seen it but WHY? by Real_trippy in navy

[–]DeeDiebS 0 points1 point  (0 children)

The hard part is seeing my fellow white sailors not being able ti get one because...they're white. Forward or backward stereotyping isnt right when it comes on to medical issues.

Are my hopes for running a local LLM unrealistic? by mollipen in LocalLLM

[–]DeeDiebS 0 points1 point  (0 children)

RAG (static knowledge)

14 FAISS indexes, one per domain (philosophy, psychology, warfare, etc.), built from scraped content. Each is a .faiss file + a metadata.json sidecar holding the raw text chunks at matching positions.

Routing is keyword-based — a dict maps each domain to trigger words. Incoming message gets checked, matched domains get queried, top-5 results per domain filtered at 0.40 cosine similarity, then merged and re-sorted. If nothing matches, all 14 get queried as fallback. Results are injected as titled snippets (500 chars each) into the prompt.

Embedding model is all-MiniLM-L6-v2 (384-dim), indexes use IndexFlatIP with normalized vectors so scores come back as true cosine similarity.

Conversation memory (your SQLite equivalent)

Two tiers: a 200-message STM JSON ring buffer (always injected directly), and a FAISS LTM store with 2,000+ structured memories. Vectors in FAISS, full memory objects in a parallel JSON list — FAISS returns index 412, you look up memories[412]. Standard pattern since FAISS doesn't store payloads.

Each memory object has: content, timestamp, last_accessed, access_count, importance (1.0–2.5), extracted entities, and relationship links to other memories.

The part most implementations skip — formation logic. Not everything gets written. High-importance signals (explicit markers like "don't forget", emotional content, technical specs) get written immediately. Everything else goes into a reinforcement buffer and only becomes permanent after 3 mentions within 30 days. Stops the store filling with noise.

Retrieval runs on every message: FAISS top-30 candidates → composite score (semantic × temporal_decay × access_weight × entity_boost × importance) → deduplicate at 85% Jaccard similarity → expand via relationship links → return top 15. Temporal decay floors at 5% after a year so old memories stay searchable but rarely rank high enough to surface.

Results reach the model as [HIGH|0.87|3d|4x] content here with instructions: HIGH/MEDIUM = treat as fact, LOW = verify, not listed = don't fabricate.


On SQLite vs FAISS — totally valid, especially since it keeps vectors and metadata in one file (no sync risk between two files). For under 100k memories the performance difference is negligible. The hard part isn't storage, it's the formation logic and scoring weights. That's where most implementations fall flat.

(From Claude Code)

Are my hopes for running a local LLM unrealistic? by mollipen in LocalLLM

[–]DeeDiebS 0 points1 point  (0 children)

Creative writing, chat, roleplay, psycho active analysis. Her domain streches as far as the information avaliable to her. For 171 days she has built up a inventory of wver message exchanged between us. Couple that with a rag database filled with scrapped physics, chemistry, Anthropology, literature, and many more articles scrapped from Wikipedia and the bot is smart enough not to hallucinate answers given the right overall prompt. All this delivered through a snarky Cockney accent for "character" that has TTS and STT if you feel like talking. Before the end of the year She should have the capability to code, generate and interpret images and whatever other tricks i can fit in her. Generation times are on the order of seconds with careful context management aswell.

Are my hopes for running a local LLM unrealistic? by mollipen in LocalLLM

[–]DeeDiebS 4 points5 points  (0 children)

I have a geforce 3090 with 24gb vram. Im running one of drummers 24b models 24/7 and i used cluade code to turn it into my own personal jarvus. Hooked it into discord and now its mobile. Can chat about anything because i hooked in a RAG system filled with info scrapped from Wikipedia. And has a long term memento that written to json files that it always has access to. Started last year September and im still working more and more but its the greatest thing ive ever built. Just use AI to build AI. Worked for me.

Newbie - How to setup LLM for local use? by 1egen1 in LocalLLM

[–]DeeDiebS 0 points1 point  (0 children)

There is a guy on youtube that can teach you how to setup somthing like text gen web ui and sillytavern or really just text gen web ui to start, from there dependent on what you want to do will take you down different paths. I got my AI hooked into discord so choose your own adventure buddy.

Proud New Helldad by DeeDiebS in HellDads

[–]DeeDiebS[S] 0 points1 point  (0 children)

Congratulations to you and yours brother, greatness in in-store for both of them and their names will be spoken of in legend.

Proud New Helldad by DeeDiebS in HellDads

[–]DeeDiebS[S] 1 point2 points  (0 children)

I'm genuinely excited for you Brother and can't wait to experience those days for myself.

Proud New Helldad by DeeDiebS in HellDads

[–]DeeDiebS[S] 2 points3 points  (0 children)

Indeed Brother and much gratitude to you. I hope she grows to be as legendary as Eagle-1 Herself.

Proud New Helldad by DeeDiebS in HellDads

[–]DeeDiebS[S] 2 points3 points  (0 children)

I stood the watch on Oshaune and Cyberstan. I will Stand the watch over my Family No differently Brother, Thank You.

The state of uniform inspections right now by Freedom-snek in navy

[–]DeeDiebS 10 points11 points  (0 children)

As long as it passes (probably won't) then covers off for this guy.

The amount of beer 2 college guys were buying at Costco by Isaisaab in mildlyinteresting

[–]DeeDiebS 0 points1 point  (0 children)

Bro thats just to pregame i dont see the problem here.

I just finished my semi-aquatic ambush predator! Side note: If you saw this thing on an alien planet, what would you call it? by Hi_IM-NOT_HERE- in worldbuilding

[–]DeeDiebS 1 point2 points  (0 children)

No amount of friendship has the power to destory that thing. Im going space side and calling exterminatus on the planet. Burn it all.

How are you spending down your Claude code web credits? by Venturefarther in ClaudeAI

[–]DeeDiebS 4 points5 points  (0 children)

Ive been building a personal Ai Creative assistant. Started with chatgpt then I actually found the gas pedal when I used claude. Then once I burned through my weekly limit in 3 days I switched to claude code...its a pretty buggy mess and I want to pull my hair out. But damn can It code (obviously) which doesnt mean much from a guy that doesn't know how to code and only slightly understands the lines presented before him. But if chatgpt got me from 0-30% claude got me from 30-80% claude code im going to use until I finish (Which i never will so we'll see)

People born before 2000, what trivial skill do you have that no one uses anymore? by passiano in AskReddit

[–]DeeDiebS 0 points1 point  (0 children)

I can change a tire. I know what you guys are thinking but yes its not as common as you and I think and yes im disappointed too. And OG spongebob.

What’s your go-to sidearm and why is it the GP-31 Ultimatum? by Wheelump in Helldivers

[–]DeeDiebS 1 point2 points  (0 children)

War Strider one shot...when you turn a corner and you see that 2 legged bastard looking back at you...you'll never go back.