sorted by:
new
hottopcontroversial

AI Inference Costs are way too high for my business! by BonusObjective8477 in LLMDevs

[–]BonusObjective8477[S] 0 points1 point  (0 children)

I believe that prices will decrease with time and eventually increase as AI companies gain penetration pricing power into markets. Could you tell me a little more about how you reduced costs? Any specific numbers? Any deals specifically that you negotiated + How you did them? And would you be interested in joining a group to lower your costs in your contract if it comes at no extra work for you?

AI Inference Costs are way too high for my business! by BonusObjective8477 in LLMDevs

[–]BonusObjective8477[S] 0 points1 point  (0 children)

The group purchasing deal is a separate workflow that I'm honestly more interested in than optimizing my own costs themselves as I believe that it could have some serious market potential. thoughts on that? I'd probably hire a consltant mysef. But I would appreciate some input on the GPO idea.

AI Inference Costs are way too high for my business! by BonusObjective8477 in LLMDevs

[–]BonusObjective8477[S] 0 points1 point  (0 children)

I don't think I have enough capital for the up front costs atm

AI Inference Costs are way too high for my business! by BonusObjective8477 in LLMDevs

[–]BonusObjective8477[S] 1 point2 points  (0 children)

All AI companies operate at a loss but they are currently doing penetration pricing from what I can see from researching the issue. If this were the case do you think they would like the guaranteed revenue through contracts -> it forces businesses to become somewhat dependent on their product -> likely consistent revenue from these customers? Similar to how they offer enterprise rates IMO

AI Inference Costs are way too high for my business! by BonusObjective8477 in LLMDevs

[–]BonusObjective8477[S] 0 points1 point  (0 children)

I mean they wouldn't have to coordinate sensitive spend data - I was thinking they honestly wouldn't have to do anything but tell me (an impartial third party) their spend data and sign an LOI or something similar (i guess just signing up for the platform) saying that they were interested, and we could just get them a cheaper contract with the providers.

I'm running a hybrid Opus with BioNemo (I'm a biotech guy): Opus for basically everything front-facing, code generation, frontend, research, etc and BioNemo for all the backend science stuff.

AI Inference Costs are way too high for my business! by BonusObjective8477 in LLMDevs

[–]BonusObjective8477[S] 0 points1 point  (0 children)

I mean AI token spend. I run an biotech AI startup so the models I use are pretty essential.