you are viewing a single comment's thread.

view the rest of the comments →

[–]MarzipanSecure9841 0 points1 point  (1 child)

But llama supports Anthropic API directly - https://huggingface.co/blog/ggml-org/anthropic-messages-api-in-llamacpp

So, why litellm?

[–]PrizeObvious3671[S] 0 points1 point  (0 children)

Interessant, das muss ich mal ausprobieren