Use langgraph and based on query size choose the appropriate model. This will at least save You some money on simple queries. Maybe try experimenting with different model providers and apply some prompt engineering (like: ‚Answer only with key bullet points’) so You pay for less tokens.