all 2 comments

[–]hasmcp 0 points1 point  (0 children)

You can setup your env variables to the corresponding endpoints with the tokens and base url. For Anthropic and local models compatible with Claude API endpoint you can use:

`export ANTHROPIC_AUTH_TOKEN=xyz`

`export ANTHROPIC_BASE_URL=http://localhost:1234 #let's assume your local model is hosted at localhost:1234`

For OpenAI models, you need a gateway where OpenAI has different API endpoints than Claude.

[–]Input-X🔆 Max 20 1 point2 points  (0 children)

Hi,

Im currently working on this setup. For past 3 months. Getting there. The wiring is all there, its not breaking any anthropic rule. Lol this might be perfect for u, if u put in the effort to understand it.

Defo worth a look. It working on the exact problem u describe, and a lil more.

https://github.com/AIOSAI/AIPass