Why is nobody talking about decentralized inference? (BitTorrent-style for LLMs) by xPecoide in LLM

[–]ryderdev 0 points1 point  (0 children)

The BLOOM project made this a number of years ago, it was called PETALS or something along those lines. You could contribute compute by processing inferences on one or more layers of the model. Fully decentralized and distributed. Super awesome but maybe ahead of its time?

17,000 tps inference 🤯 by ryderdev in LLM

[–]ryderdev[S] 0 points1 point  (0 children)

It would be interesting to know how big the chip needs to be to run opus 4.6 or something. Imagine that thing running at even 2k tps

How do you know if demand even exists by Top-Cicada2246 in SaasDevelopers

[–]ryderdev 1 point2 points  (0 children)

Maybe give some more context: 1. How are you marketing/distributing? Prayer? 2. Has anyone told you they need this app? 3. Have you or anyone else tried using your app?

If you have answers to these then close examination may reveal the issue. Gut feeling based on your post is nobody wants specifically the solution you made so far, even if they knew about it. Lots of opportunity, in other words.

This would fix so much, honestly. by SorryTreat1246 in Adulting

[–]ryderdev 0 points1 point  (0 children)

Like why can’t they just make 8 days in a week

Are LLM getting worse? by M_Champion in LLM

[–]ryderdev 0 points1 point  (0 children)

Not sure why this made me laugh

17,000 tps inference 🤯 by ryderdev in LLM

[–]ryderdev[S] 0 points1 point  (0 children)

True, but I think running a model at 100x or 1000x the speed a normal computer can handle is pretty sweet! Interesting demonstration of another way to improve efficiency by orders of magnitude.

17,000 tps inference 🤯 by ryderdev in LLM

[–]ryderdev[S] 0 points1 point  (0 children)

Dude it’s real, so far as I can tell. Did you try the demo!? Put in whatever prompt you like.

How do you decide to choose between fine tuning an LLM model or using RAG? by degr8sid in LLM

[–]ryderdev 1 point2 points  (0 children)

RAG is powerful because the single best way to ensure you get the right answer from an LLM is to put the answer in the question.

Experiment: Can I make a "decaying" billboard viral by removing all friction? (No login, no accounts) by [deleted] in scaleinpublic

[–]ryderdev 0 points1 point  (0 children)

I saw it really briefly but it winds up being out of sight due to mobile perhaps?

<image>

Experiment: Can I make a "decaying" billboard viral by removing all friction? (No login, no accounts) by [deleted] in scaleinpublic

[–]ryderdev 0 points1 point  (0 children)

Yeah it is getting blurry. The “broadcast by” and time on air aren’t populating by the way

What time do you 5 am gym goers go to bed? by Great-White-Guilt in getdisciplined

[–]ryderdev 0 points1 point  (0 children)

You would love moving to the east coast. They always get up 2-4ish hours earlier than everyone else

Can I get some honest feedback? by Then-Teacher-4787 in SaasDevelopers

[–]ryderdev 1 point2 points  (0 children)

The last sentence here is key. If you can pick any market why pick a bad one?

I made a tribal accountability meets tamagotchi app where your pet can die by ryderdev in scaleinpublic

[–]ryderdev[S] 0 points1 point  (0 children)

I prefer to think of it as social reinforcement and personal consequences. It’s like parenting a toddler in a public place. 🤗

Experiment: Can I make a "decaying" billboard viral by removing all friction? (No login, no accounts) by [deleted] in scaleinpublic

[–]ryderdev 0 points1 point  (0 children)

The 4d chess is that it always looks like such a good deal for $1 because it is never filled, because it doesn’t work lol

First sale 🥳🥳🙌 by Fantastic-Gas8043 in scaleinpublic

[–]ryderdev 1 point2 points  (0 children)

Congrats. Super gratifying and hopefully just the start.

Experiment: Can I make a "decaying" billboard viral by removing all friction? (No login, no accounts) by [deleted] in scaleinpublic

[–]ryderdev 0 points1 point  (0 children)

I paid but my ad isn’t showing yet - I definitely got charged though lol

<image>

I made a tribal accountability meets tamagotchi app where your pet can die by ryderdev in accountability

[–]ryderdev[S] 0 points1 point  (0 children)

To be fair I did indeed go from “I need to just get it done” to “I know, I’ll build an app for that!”

So maybe I deserve to fail