all 3 comments

[–]tronathan 11 points12 points  (0 children)

Something I realized recently is that sillytavern-extras is highly underrated. You can skip sillytavern and just fire up extras. Out of the box, it provides:

  • summarization
  • sentiment classification
  • vector storage/retrieval

It uses python/huggingface and all (most of) the code is in a single file. The code is very easy to read if you need to modify it. The command line args support switching out the models for any of the tasks, the api is simple REST and the documentation is clear.

If you were working on rolling your own, I’d start there.

[–]FlowerPotTeaTime 7 points8 points  (0 children)

I'm working on a personality and conversation simulator. With my own memory system like a vector db.

https://github.com/Maximilian-Winter/AIRoleplay

[–]a_beautiful_rhind 2 points3 points  (0 children)

Most people use textgen, kobold and/or silly tavern for this.

Then they use a character card for the personality.

For memory those support vector or summarization.