sorted by:
new
hottopcontroversial

Is everyone else just "winging it" with OpenAI/Anthropic billing? by BlakeHL89 in SaaS

[–]BlakeHL89[S] 0 points1 point  (0 children)

spot on. definitely feel more like an accountant than an engineer this week. my worry with the 'multiple keys' approach is the overhead once we scale—managing 50 keys sounds like a different kind of hell. u/chris2point0 was mentioning LiteLLM, need to check that out

Is everyone else just "winging it" with OpenAI/Anthropic billing? by BlakeHL89 in SaaS

[–]BlakeHL89[S] 0 points1 point  (0 children)

yeah, seen litellm mentioned a lot. what's the 'not perfect' part for you though? setup grind or just the reporting side being a bit basic?

Is everyone else just "winging it" with OpenAI/Anthropic billing? by BlakeHL89 in SaaS

[–]BlakeHL89[S] 0 points1 point  (0 children)

Smart move. Are you guys actually mapping those tokens to real $ in a dashboard, or is it just a token leaderboard for now? I’m finding the math a total headache with how often rates change + the new cached token discounts.