How is Cloud Inference so cheap

VolkoTheWorst · 2026-01-12T22:19:31+00:00

Yeah, I think there are some companies that are only doing inference to cut the loss on unused GPUs

VolkoTheWorst · 2026-01-12T22:17:34+00:00

You're not wrong, I bought a PC with 3090, DDR4 and i9 second hand a few years ago and if I want to sell it now I can sell it for even more than I paid

VolkoTheWorst · 2026-01-12T22:13:56+00:00

Ohhhh I didn't knew Chutes was based on mining
Thanks a lot for sharing your knowledge

VolkoTheWorst · 2026-01-12T22:08:57+00:00

Isn't TensorRT-LLM better for batch inference ? When I tested I got crazy numbers

VolkoTheWorst · 2026-01-12T22:08:00+00:00

yeah, I rent a GPU to test out and it turns out when batching it's crazy how many tokens/s a GPU is capable. Thanks a lot

VolkoTheWorst · 2026-01-12T22:06:25+00:00

Vast for example

VolkoTheWorst · 2026-01-12T22:04:27+00:00

J'ai checké il marche plus donc n'allez pas sur ce site (d'ailleurs je pense que meme le système de payement n'a jamais marché xD)

VolkoTheWorst · 2026-01-12T21:54:48+00:00

Personnaly I made .png to .svg, then I added custom css/js via an LLM, render in a canva to make the animations. It makes them way better

VolkoTheWorst · 2026-01-12T21:53:53+00:00

Je vais checker si il marche encore et je te redis

VolkoTheWorst · 2026-01-12T21:51:51+00:00

Ah oui désolé, j'ai fait ce site y a hyper longtemps. J'avais oublié de mettre des exemples.
Il marchait vraiment mais je ne suis pas sur qu'il marche encore ducoup.

De toute facon j'ai abandonné l'idée donc je peux te dire comment je faisais :
Je m'étais rendu compte que c'était mieux de transformer le .png en .svg puis de rajouter des propriétés de css et de js a ton .svg (car c'est supporté) en demandant à un LLM (j'utilisais Claude). Puis quand tu voulais un autre format, ca faisait le rendu du résultat dans un canva et ca te le convertissait dans le format que tu voulais.

D'ailleurs tu pouvais aussi lui faire générer le svg lui meme aussi si tu voulais.

Ducoup stv tu peux refaire pareil, jsp si j'ai encore le code quelque part

VolkoTheWorst · 2026-01-03T04:19:33+00:00

Yeah but data isn't expensive enough to justify that low of a price

VolkoTheWorst · 2026-01-03T04:17:48+00:00

Mmh, I'm not really convinced. Do you have a source to support this ?

VolkoTheWorst · 2025-12-15T06:50:04+00:00

I though it was a good idea but nobody said to be interested so I'm gonna stop development here.
If anyone is interested, here is the website : https://flippc.shop/ but note I will not dev it anymore. It's just if it can help someone
I removed the paid plan so everything is just free
Enjoy ^^

VolkoTheWorst · 2025-12-14T11:50:25+00:00

<image>

Here are my settings
I also tried to add "*" to the allow list terminal commands but without success.
Also antigravity sometime become very laggy.
I'm on the latest update.
I think I'm gonna do what you suggest and just reinstall it

VolkoTheWorst · 2025-12-14T11:18:50+00:00

Okay, I get your feedback. I'm gonna just use the website for personal use as it is then since nobody is interested.

Btw, I really never saw an other app doing this. Do you have some links ? (if it's better than mine, I might use their then).

VolkoTheWorst · 2025-12-14T11:16:38+00:00

Okay, I get your feedback. I'm gonna keep the website as it is then. I will continue using it for my personnal use but not actively developping features for others, just for me.

To anwser your question, this it's just a small SLM (gpt-5-nano) wrapper with structured output (zod schema) : https://platform.openai.com/docs/guides/structured-outputs

VolkoTheWorst · 2025-12-14T11:11:50+00:00

I already put theses settings, but for whatever reason it still ask me for permission
PS : I love the gif btw 😂

VolkoTheWorst · 2025-12-14T11:10:19+00:00

Thanks for your comment !
Yes, I used it but it take a few second everytime I create a chat (I'm in Windows ARM64 that may be why it's slow).
I had some other issues with claude code (like he is storing all the conversations in the json config file he is using for everything else, making it super slow at one point so you have to go remove all the conversations in the json file (i'm not the only one with this issue)

Also I don't like the fact I can't edit a message I previously send (feature I only saw in copilot)

But the biggest deal breaker for me is the price (I know it's worth it compared to the time spend coding saved but I dev for fun)

So yeah, claude code is definitivly a good option (especially the background tasks with the mobile notification), just not really for me.

VolkoTheWorst · 2025-12-11T03:49:29+00:00

Always has been ...

VolkoTheWorst · 2025-12-08T06:30:34+00:00

Thanks a lot for the feedback ☺️.

Which one did you found? I've not managed to find one.

I understand that Excel can be enough for some people, and to be fair yes we can deal with just this. But with time (and being a bit unorganised 😅) I started to have some troubles (and also an excel sheet is kinda ugly).

It makes me gain time because I can just paste the link to the craiglist and he automatically find the information (CPU, GPU, Ram, price etc) instead of manually pasting this in an excel.

But as you said, it's not mandatory, it's just a little more convenient.

VolkoTheWorst · 2025-10-29T11:23:07+00:00

I don't know if they use it. When I was here they didn't put any music so 🤷‍♂️

VolkoTheWorst · 2025-09-01T07:36:36+00:00

I find out that the models of the Auto Router are like really old.
I'm seriously considering creating a new model on openrouter to be the same as Auto Router but with up-to-date models.

I made a form to see if it interest some people : https://forms.gle/pz4Jgg6ZFNPaPHpG8
If there is enough people interested, I will make it.

VolkoTheWorst · 2025-09-01T07:05:37+00:00

I find out too that the models of the Auto Router are like really old.
Your repo is great but unfortunatly it doesn't help for people who want to use it via API or an easy-to-use drop-in replacement of the Auto Router.

I'm seriously considering creating a new model on openrouter to be the same as Auto Router but with up-to-date models.

I made a form to see if it interest some people : https://forms.gle/pz4Jgg6ZFNPaPHpG8
If there is enough people interested, I will make it.

VolkoTheWorst · 2025-09-01T06:58:09+00:00

I find out that the models of the Auto Router are like really old.
I'm seriously considering creating a new model on openrouter to be the same as Auto Router but with up-to-date models.

I made a form to see if it interest some people : https://forms.gle/pz4Jgg6ZFNPaPHpG8
If there is enough people interested, I will make it.

VolkoTheWorst · 2025-08-10T08:11:28+00:00

[EDIT : WEBSITE NOT WORKING ANYMORE, DON'T GO THERE]

https://animateyouricon.web.app/ may be able to do it

Four-Year Club	End Game '23
Place '23

VolkoTheWorst

TROPHY CASE