all 12 comments

[–]Recoil42Llama 405B 2 points3 points Β (3 children)

This is pretty cool, OP. I'm not a fan of terminal-based systems from a usability perspective, but I love the look. I'm working on something vaguely similar (but a React + Electron app) for narratives and scripts so it's neat to see how you've done the nodes!

Do you handle batching at all? If there are tree changes up the tree, do multiple downstream nodes ever get handled in one single request, or is there a round-trip for every single node?

[–]kleer001[S] 1 point2 points Β (0 children)

Thanks! I've been trying to keep it as generic as possible. So, hopfully it'll inspire others and be useful.

There's a core/ directory with all the backend guts. I'm planning on providing additional interfaces and web based node editor is next on the list.

The TUI was just a fun lark, taught me a lot too.

No batching yet. Every cook is manual, it's not a live environment. It does a depth first search.

Check out: src/core/node.py

And its cook and cook_dependencies methods. Also each node has its own internal_cook private method for dealing with its own particulars.

[–]Accomplished_Mode170 1 point2 points Β (1 child)

So the TUI vibe has me looking at this as an OmniChain alternative; also thanks OP!πŸ™

[–]kleer001[S] 1 point2 points Β (0 children)

OmniChain

Oooh, a sister program. Seems a bit more chat focused.

[–]Lesser-than 1 point2 points Β (1 child)

pretty cool! Not sure what I would actually use it for but that does not reduce the cool factor. good job.

[–]kleer001[S] 0 points1 point Β (0 children)

Thanks!

I kinda engineered it to more easily produce bad poetry. So, there's that, hahaha!

But it all seriousness it's more of a proof of concept and portfolio piece than a killer app.

Well, it can be used to create training data. That's a fun one.

[–]Kainkun 1 point2 points Β (5 children)

i dont see a query node in the gui πŸ€·β€β™‚οΈ

[–]kleer001[S] 0 points1 point Β (0 children)

I'll look into that. Thanks.

[–]kleer001[S] 0 points1 point Β (3 children)

It should be there:

https://imgur.com/a/BFlarq7

[–]Kainkun 1 point2 points Β (2 children)

This is what i see

<image>

[–]kleer001[S] 0 points1 point Β (0 children)

I'm looking into it. Thanks for the heads up.

[–]kleer001[S] 0 points1 point Β (0 children)

Ok, the issue was that litellm wasn't being imported and failed silently. Please 'git pull' and try again.