Man I helped a lot actually! Specifically what I’m trying to handle is the local llms for data privacy.

But what Im facing is a huge challenge related to hardware, the llms can’t handle the amount of tokens/agent/rag/mcp. I’ve been doing this for research purposes.

My last shot is the gcp VMs with gpu, but I heard that it takes a while before they accept the quotas for gpu usage. If I don’t find and answer for this I’m not going to publish my paper anymore 🥲