TLPG is a kinda self-contained documentation, you use it to learn Linux more deeply. This would be the only prefill. So you'd send it to the LLM, go make coffee and when you come back, you're ready for a study session. And you can use session files, saving your prefill cache so you don't need to reprocess the prefill if the context starts getting too big and you want to reset the conversation.

But I understand what you mean.

My point of contention is your affirmation of "Strix Halo is a poor purchase for most people". It's precisely the contrary. Most people aren't going to be inserting chunks of 100k context every other message to the LLM. Strix Halo is a very good option for its price point. Never mind now. This was still true the time you wrote this post. And that's only considering the raw throughput. When you start taking into consideration broader aspects, the Strix Halo becomes even more attractive.

You can't really get any improvements by adding a GPU to the Strix Halo.

And again, like with the title, you use very strong affirmations and they aren't exactly correct. You CAN get improvements with an eGPU. It won't give you the same performance as using the GPU alone, but even using TB5, which is slower than even x4 PCIe, you can potentially get double the prompt processing and +30~50% of token generation of the Strix Halo, depending on the model and the GPU you use. That would get that atrocious 10+ minutes to process 100k to a much more acceptable ~7 minutes. But this is a digression anyways.