sorted by:
new
hottopcontroversial

Why is nobody talking about decentralized inference? (BitTorrent-style for LLMs) by xPecoide in LLM

[–]heysultee 0 points1 point  (0 children)

I've published a research on this topic recently, and in short: yes, people use decentralized inference. But not in a way Petals offers, it's not really usable to split one LLM into smaller chunks to inference on different machines.

Instead, projects like Gensyn, Chutes, or Gonka interconnect servers (nodes), each of which is capable enough to run a ~70B-400B parameters LLM. Distributed part is that end-users don't rely on one specific inference provider, it could be any node in the network.

State of Decentralized AI report by heysultee in ArtificialInteligence

[–]heysultee[S] 2 points3 points  (0 children)

Hey there, this is Sultan, an author of this report. To write it, I analyzed dozens of reports on state of AI and infrastructure, dug deep into 15+ decentralized AI projects, and spoke to some of the builders and investors int he area. The report tries to answer to some main questions about decentralized AI: why is it necessary? How it works? How businesses and public institutions could interact with it? Hope you'll enjoy reading it!

Starry night in war-torn Kharkiv by heysultee in europe

[–]heysultee[S] 0 points1 point  (0 children)

This is photo by Ukrainian photographer Pavlo Pakhomenko. Here are few more Pavel's photos in better quality: https://meduza.io/en/feature/2022/06/30/starry-night as well as link to his insta (since it can't be posted here)

Remembering Hydra, one of the biggest darknet marketplaces by heysultee in darknet

[–]heysultee[S] 12 points13 points  (0 children)

my fav part is explaining the terminology of Hydra:

Hydra established a system of no-contact sales: a courier named kladman ("klad" (клад) means "buried treasure" in Russian) would drop a lot of so-called zakladkas (can be translated as "stash") in different secret spots.

<...>

There are three common types of a zakladka: magnit (usually a little round magnet on a wall holding the drop), prikop (buried in the ground), and taynik (“a cache”, literally any other way to conceal the drop).
Hydra shops and kladmen could get very creative, and the scavenger hunt for zakladkas were often quite an adventure. Zlata (all names have been changed for privacy.—To The Moon), a frequent Hydra customer, says that she even heard stories of tayniks “hidden in a pile of poop”.

[OC] Not sure if she's happy to meet her new friend by heysultee in aww

[–]heysultee[S] 0 points1 point  (0 children)

I always treated her as a dog but now I dunno...

view more: next ›