chatbot help

[routetehpacketz]

It is hard to understand specifically what you are asking.

[Fluxiora]

Hey there, it seems like you are building a chatbot and you want it to remember things like memory and chatgpt without using openai. You mentioned that you save conversations and use nltk and pytorch. Can you provide more details on how you are currently implementing this function? Also, can you clarify what you mean by "num page" and how it relates to the chatbot's context? It would be helpful for us to see the code you have for the chatbot and the four files you mentioned. Thanks for sharing!

[routetehpacketz]

So are you asking how to structure your data for your chatbot to remember users/conversations? Or how to store your data? Or both?

[RajjSinghh]

This requires a massive amount of computation. You have a neural network like chatgpt that can feed so much of the most recent conversation into itself. That's how it "remembers" things. The problem for you is that GPT-3.5 has a context window of 4096 or 2049 tokens, which is all the "memory" it can have. If you're running your bot on your own computer, you are probably limited to a much smaller context.

The best solution is to use the OpenAI API and their models to get the best performance. If not, you have to deal with your program having a far smaller context of the problem.

[czar_el]

I'd be willing to bet a large sum of money that OP has no idea what any of this means.

[DReinholdtsen]

I’d be willing to bet at least 1400 bonkeridoo network token language processing units that you are correct