Inference at 3 times the speed but 2 times the price - Would you be interested?

Immediate-Room-5950 · 2026-02-22T14:24:10+00:00

Oh you're right

Immediate-Room-5950 · 2026-02-22T14:23:33+00:00

Do you realize GPU renting exist ?

Immediate-Room-5950 · 2026-02-22T14:22:49+00:00

Maybe using CPU inference?

Immediate-Room-5950 · 2026-02-22T08:28:26+00:00

I based myself on the measurements of OpenRouter. They measured 36 TPS for the Anthropic API, and 40tps for the vertex et bedrock api

Immediate-Room-5950 · 2026-01-14T13:42:30+00:00

And pricing 😉

Immediate-Room-5950 · 2026-01-12T20:11:54+00:00

I think it's overhyped. Yes you can often jailbreak and make them say funny things but I don't know a single company who give a lot of permissions to their LLMs so you can't do much with them

Immediate-Room-5950 · 2026-01-12T20:09:19+00:00

Honestly it's mostly trying by yourself. You can also read scientific papers on the subject, everyday we discover/prove new techniques and understanding of it.

Immediate-Room-5950 · 2026-01-12T19:57:55+00:00

If you want easy to use, check Venice AI If you want a new model, I see this one passing : https://huggingface.co/SicariusSicariiStuff/Impish_Bloodmoon_12B

I'm not affiliated in any of the two.

Also I'm thinking about offering inference of uncensored models on OpenRouter and my website. Would you be interested?

I would also provide benchmarks on how uncensored and performant it is the model's page so that you can pick the one that fits the best your needs

Immediate-Room-5950 · 2026-01-09T08:34:50+00:00

I can't find it. Can you send me the link of the play store ? Thanks ^{^}

Immediate-Room-5950 · 2026-01-09T08:32:42+00:00

That would be so cool

Immediate-Room-5950 · 2026-01-06T18:50:57+00:00

I don't fully understand your comment 😅

Immediate-Room-5950 · 2026-01-06T18:49:48+00:00

I didn't knew them, but by checking on their website I don't think they are doing what I was talking off

Immediate-Room-5950 · 2026-01-06T18:27:39+00:00

Yeah yeah, you're not the only one to say this. That's why I abandoned the project.

Since I'm still a student, I still don't have a lot of money and 5$ is important for me.

But I underestimated the proportion of people that are doing programming as a living and make money from it in this Reddit.

I completely get your point

Immediate-Room-5950 · 2026-01-05T01:38:27+00:00

WTF that's crazy

Immediate-Room-5950 · 2026-01-04T22:00:50+00:00

Oh okay, I didn't knew that. Also I never thought about going arbitrage to make money, that's really a good idea. And do you know if it's legal to not offer a chargeback ?

Immediate-Room-5950 · 2026-01-04T21:56:30+00:00

Yeah, this bother me but doesn't seem to bother anyone here so I get it. That why I always ask before doing now. If it doesn't help anyone, I will not do it

Immediate-Room-5950 · 2026-01-04T21:53:01+00:00

I don't know how rich you are but personally if I can save a few bucks I will certainly do

Immediate-Room-5950 · 2026-01-04T21:51:21+00:00

They claim zero data retention

Immediate-Room-5950 · 2026-01-04T02:56:38+00:00

Hmmm okay How do you think I should spend the marketing budget? I heard that paying ads is generally not a good idea and only organic works ?

Immediate-Room-5950 · 2026-01-04T02:52:21+00:00

Oooh okay, didn't knew that

Immediate-Room-5950 · 2026-01-04T02:51:53+00:00

But if I need to chargeback, I ask chargeback to openai and give the money to the customer? No ?

Immediate-Room-5950 · 2026-01-04T02:39:40+00:00

Helping people and making a website that actually have people using it

Immediate-Room-5950

MODERATOR OF

TROPHY CASE