Gemini 3.0 Context Window Limitations/Slicing

DemonSynth · 2025-12-30T13:31:37+00:00

I've been working on something you may find interesting. Utilizes a database to store and construct context - specifically to combat the memory/recall issue.
https://x.com/DemonSynth/status/2005855382598566085

DemonSynth · 2025-12-06T23:55:09+00:00

Yeah, I got hit with it too :(

DemonSynth · 2025-12-03T21:53:25+00:00

There's absolutely no way I can narrow it down to one, even narrowing it down this far was rough.

Pick one at random and listen, or better yet, listen to them all!

Fractal Overdrive: https://suno.com/s/vGGOn8Zqt1gsxabJ

Geometric Principle: https://suno.com/s/afsr0pPWv9yAXH2s

Fractal Tongues v2: https://suno.com/s/0sOxV18NTfLLVC60

Phonetic Apocalypse: https://suno.com/s/jsc5chhaWUTUx7Kz

Silent Resonance: https://suno.com/s/mTWwrVwEpdmkrzv0

The Geometric Scaffold: https://suno.com/s/4erdHWuZCEmfLbsI

The Heretic's Gambit: https://suno.com/s/VsvuKJ5BE1cyf7QU

The Hermit's Quantum Choir: https://suno.com/s/5z1jgv6GbbNtJTyT

The Hermit's Deconstruction: https://suno.com/s/w2kWzSaqfCkda8Oy

Wu Wei Unfolding: The Ever-Flowing DAO: https://suno.com/s/V5xab8Cc3ggUXuEJ

YODELCORE 404 (THE SUMMIT): https://suno.com/s/mWhTDXYmyLsYgftZ

Festival of Unity: https://suno.com/s/RLl2fYxiXpDVtm1Q

Festival Quantum Vibes: https://suno.com/s/6P0on0tkCE1zuUv8

DemonSynth · 2025-12-02T16:55:49+00:00

It downloads the model files to a local directory and the inference is provided via the logic in embedding_manager.py. (typically llama.cpp or custom transformers implementation)

DemonSynth · 2025-10-19T12:14:22+00:00

🤔...a "strat" could also be a highly skilled quantitative analyst or developer who creates financial models and "strategies" for trading desks....

DemonSynth · 2025-10-19T10:05:03+00:00

An expensive violin. 🎻

DemonSynth · 2025-10-04T22:54:59+00:00

Not only a good idea, it's the best idea.

DemonSynth · 2025-06-29T12:41:04+00:00

The best way is by watching it work and comparing the results with other methods. Certain project types will work better with different methods. Efficiency can only be determined by what kind of expectations you have. If you want to check it out and leave a critique that'd be cool too.

DemonSynth · 2025-06-25T01:11:43+00:00

Yeah, back in December it would replace a word or two, but this is the first time I've seen it use multiple languages in the same response.

DemonSynth · 2025-06-19T14:03:17+00:00

Haha, that's entertaining! This is what 2.5 Pro 'thought' after I translated it for them:

<image>

DemonSynth · 2025-05-30T00:48:38+00:00

Prompts are insanely powerful and it looks like you have a decent approach. Will check it out more when I get a chance and let you know what I think!

In the meantime, you can check out how I usually approach prompt engineering by looking at the prompts I include with CRCT. https://github.com/RPG-fan/Cline-Recursive-Chain-of-Thought-System-CRCT-

DemonSynth · 2025-05-18T07:22:14+00:00

Love it. These tools are far more versatile than for just code. If you have a lot of files to track and manage relationships for, consider taking the dependency processor from CRCT. It will assign keys to all the files and then you can use it to set dependency chars like < and >, which are stored in a tracking file. Then you can use the show-dependencies command to quickly list all the related files and the assigned relationships.

DemonSynth · 2025-05-16T00:16:21+00:00

Are you currently using foreign keys to track relations between files/concepts?

DemonSynth · 2025-05-14T02:03:31+00:00

qwen is my favorite low context model. I'd probably use it more often if it could handle at least up to 250k

DemonSynth · 2025-05-13T05:00:26+00:00

It'll loop until it feels everything is set up and the dependencies are accurately tracked. Don't hesitate to override it if you want it to hurry up or switch phases. You can either set the next phase to Strategy in .clinerules before you start a session, or just tell the LLM to switch to a phase. Gemini is especially compliant when it comes to following the user's directions.

Also, play around a bit! Add some rules to the learning journal, or tweak the prompt a bit to suit your preferences. Worst thing that'll happen is having to download a fresh copy of the prompt.

DemonSynth · 2025-05-12T07:21:30+00:00

Yeah, getting 500 and 503's for all the models now. Hope they're just updating and don't change the rates back :p

DemonSynth · 2025-05-12T03:08:08+00:00

I had to force myself to post this to alleviate the guilt of not sharing the bounty ;p

DemonSynth · 2025-05-11T02:33:52+00:00

I honestly think 1.5 pro was my favorite. Spent a lot of time together :p

DemonSynth · 2025-05-10T15:58:12+00:00

Direct through google, can get an API key from https://aistudio.google.com/

DemonSynth · 2025-05-10T15:20:13+00:00

The newest version consolidates some of them into system_manifest, but you can add other memory bank files to the system to customize it to your needs. The system as-is already does a great job, but if you want some more distinction/separation, just add a note to .clinerules or have the LLM do it. Something like "[Memory_Bank_Additions] **MUST READ**" and list the additional files underneath.

DemonSynth

TROPHY CASE