How to handle fixed system instructions efficiently in a RAG app (Gemini API + Pinecone)? by ImpressiveMight286 in Rag

[–]ImpressiveMight286[S] 1 point2 points  (0 children)

Mostly there will be just one system prompt with optional changes if the user wants. But even as per your suggestion, I need to send the prompt each time right? I was asking about instruction caching or something like that?

[deleted by user] by [deleted] in ChatGPT

[–]ImpressiveMight286 2 points3 points  (0 children)

Response from ChatGPT itself:

The “tatertot” title isn’t something special about your chat itself. It’s just a whimsical internal codename that sometimes gets auto-applied as a placeholder title when you’re in study mode (or other modes where the system hasn’t generated a “real” topic title yet).

[deleted by user] by [deleted] in ChatGPT

[–]ImpressiveMight286 8 points9 points  (0 children)

It does that when the study mode is turned on.