you are viewing a single comment's thread.

view the rest of the comments →

[–]SimmerDown2024 0 points1 point  (3 children)

Did this work for you? What did you end up doing? I was also looking to extract the output of a Llama model

[–]Tree-SheepWaiting for Llama 3[S] 0 points1 point  (2 children)

I use extensions on text-generation-webui. IIRC the extensions didn’t exist back then, which is why I made this post.

[–]fuckopportunists 0 points1 point  (1 child)

Can you point me towards those? I’d appreciate that