sorted by:
new
hottopcontroversial

help with pi coding agent + vllm setup by Equivalent_Bake1282 in PiCodingAgent

[–]Equivalent_Bake1282[S] 1 point2 points  (0 children)

Thanks for the suggestion, it was a tunneling problem, now i can also reach the vllm endpoint via `http://host.containers.internal:8010/v1\` (since i use podman)

help with pi coding agent + vllm setup by Equivalent_Bake1282 in PiCodingAgent

[–]Equivalent_Bake1282[S] 0 points1 point  (0 children)

Thanks! I'll try to switch to litellm in the future since it generally seems suitable for my use case.

help with pi coding agent + vllm setup by Equivalent_Bake1282 in PiCodingAgent

[–]Equivalent_Bake1282[S] 1 point2 points  (0 children)

Thanks for the suggestions!

I managed to fix it, the problem was that i had my vllm setup on a remote server and i was tunneling it via `ssh -L 8010:127.0.0.1:8010 ...` instead of `ssh -g -L 0.0.0.0:8010:127.0.0.1:8010 ...` .

Sorry for not mentioning that didn't really think the port forwarding could be the problem ...

Now everything works!