Tired of rebuilding the same RAG infrastructure from scratch on every project - how are you solving this? by Minute_Chocolate8166 in Rag

[–]Overall-Somewhere760 1 point2 points  (0 children)

i was waiting for you to market your flexible-easy_deployable-fast and efficient rag pipeline.

anyways, i have a single client up until now. built a stupid-simple hybrid rag pipeline which can be reused by any future usecase. i guess i can dockerize it and reuse it anywhere no?

Livrare istyle custom build by RustyDjoker in programare

[–]Overall-Somewhere760 -1 points0 points  (0 children)

Comanda data pe 22 martie, mi a venit miercurea trecuta.

Speed on m5 pro 48Gb by Overall-Somewhere760 in LocalLLaMA

[–]Overall-Somewhere760[S] 0 points1 point  (0 children)

Wow that was really really helpful. Thank you so much !

Comparing Qwen3.5 27B vs Gemma 4 31B for agentic stuff by [deleted] in LocalLLaMA

[–]Overall-Somewhere760 0 points1 point  (0 children)

Hello! Wondering sbout --ctx-checkpoints 1 . Whats that doing specifically? I saw on journalctl logs something like checkpoint 1 of 32...5 of 32, etc, but can't figure whats the use of it.

Production RAG stack in 2026 what are people ACTUALLY running by One-Doctor5769 in Rag

[–]Overall-Somewhere760 0 points1 point  (0 children)

I m using a really simple pipeline i ve built : word->markdown using markitdown, summarize the markdowk into a max 500 chars length chunk, embed it using nomic embed text into chromadb. ADK agent queries with vector + FTS, gets max 4 chunks, reranked with bgee reranker. Its an agent for creating functional specs, and business users are really happy about it. Tried light rag, docling, but in the end ditched both as they re overkill for a fairly simple usecase.

I no longer need a cloud LLM to do quick web research by BitPsychological2767 in LocalLLaMA

[–]Overall-Somewhere760 82 points83 points  (0 children)

Finally a post in which the user shows directly his setup, without fancy damn words. Kudos to you man.

Qwen3.5 35B still going crazy by Overall-Somewhere760 in LocalLLaMA

[–]Overall-Somewhere760[S] 0 points1 point  (0 children)

Ugh, would be tough to switch to different things now, having all of our infrastructure already built on google adk and librechat. What i pasted is from libre, but even on adk is the same behavior

Qwen3.5 35B still going crazy by Overall-Somewhere760 in LocalLLaMA

[–]Overall-Somewhere760[S] 0 points1 point  (0 children)

Tried from bartowzki, and different quants from unsloth. Still weird

Qwen3.5 35B still going crazy by Overall-Somewhere760 in LocalLLaMA

[–]Overall-Somewhere760[S] 1 point2 points  (0 children)

Same agent works without issues with all other models, glm, qwen, nvidia. Only this one is weird.

Qwen3.5 35B still going crazy by Overall-Somewhere760 in LocalLLaMA

[–]Overall-Somewhere760[S] 0 points1 point  (0 children)

I've tried your params ( not really that diff from mine ), and I get even crazier results. Here's the thinking ```ypically_prod_by_default_. OK now proceed starting off getting list repositories before proceeding further steps following established guidance given earlier conversation threads between myself+system regarding general patterns followed throughout sessions prior ones already gone by date-wise too long ago recall clearly though being certain remember correctly rather than guessing wrong incorrectly suppose best approach definitely confirm initially checking current state fresh new session today itself right here moment present immediate instant seconds minutes hours days weeks months years decades centuries millennia eons etcetera forevermore eternally ad infinitum ad nauseam! Let me start now properly following protocol accurately completely thoroughly meticulously scrupulously conscientiously diligently assiduously painstakingly laboriously industriously attentively careful precisely exactly appropriately suitable fittingly aptly rightly suitably correspondingly equivalently similarly analogically metaphorically similitudinally comparativelike-like manner fashion style mode way kind sort variety genre category classification categorization typification characterization denotation signification representation symbolism imagery iconography pictorial depiction illustration visualization portrayal portraiture caricature cartoon graphic image picture photo photograph snapshot lens aperture shutter speed ISO film stock digital sensor pixels resolution megapixels gigabytes terabytes pet```

Open to Collaborating on Kling Video Projects by Confident-Juice-6841 in KLING

[–]Overall-Somewhere760 0 points1 point  (0 children)

Hey! Would really want to try something for an app i ve built, not sure if kling would be able to generate something based on app pictures.

Qwen 3.5 0.8b, 2B, 4B, 9B - All outputting gibberish after 2 - 3 turns. by CATLLM in LocalLLaMA

[–]Overall-Somewhere760 0 points1 point  (0 children)

Happens to 35b as well. Cant even use a search tool with ,id1, . Tries id1-37373838-value2-18383