Pavel Durov introduces Cocoon, a decentralized AI inference plateform on TON
Posted by No_Palpitation7740@reddit | LocalLLaMA | View on Reddit | 13 comments
Durov's tweet
🐣 It happened. Our decentralized confidential compute network, Cocoon, is live. The first AI requests from users are now being processed by Cocoon with 100% confidentiality. GPU owners are already earning TON. cocoon.org is up.
🏦 Centralized compute providers such as Amazon and Microsoft act as expensive intermediaries that drive up prices and reduce privacy. Cocoon solves both the economic and confidentiality issues associated with legacy AI compute providers.
📈 Now we scale. Over the next few weeks, we’ll be onboarding more GPU supply and bringing in more developer demand to Cocoon. Telegram users can expect new AI-related features built on 100% confidentiality. Cocoon will bring control and privacy back where they belong — with users.
COCOON Architecture
COCOON is a decentralized AI inference platform on TON that securely connects GPU owners who provide compute with privacy-conscious applications that need to run AI models. For GPU Providers, it defines how suitable hardware can become part of a confidential, attested compute layer – for Developers, it is the backend that executes model requests and settles payments on-chain.
COCOON For GPU Owners
COCOON allows GPU owners to contribute confidential AI inference capacity to a decentralized network on TON. By running the COCOON stack on a suitable TEE-enabled GPU server, you provide private, verifiable model execution and transparently receive TON payments for each processed request.
As a GPU owner, you bring the hardware and configuration – COCOON provides the protocol, attestation, and trustless payment distribution.
COCOON For Developers
Developers plug COCOON’s secure, verifiable AI inference into their apps and backends, so they can safely serve powerful AI features to their users. In exchange for these inference services, they reward GPU providers with TON.
Soon, developers will be able to use a streamlined Docker-based solution to deploy their own client instance. Stay tuned for this and more upcoming features – like a lightweight client library that lets apps plug directly into COCOON.
vsratoslav@reddit
I don't trust Pavel Durov. He talks a lot about "confidentiality," but in Russia the authorities target activists who are active on telegram.
No_Palpitation7740@reddit (OP)
The EU is on the way to do the same with Chatcontrol
Not_your_guy_buddy42@reddit
Anyone still on telegram, it's tapped, it's known, use signal instead.
BumbleSlob@reddit
Interesting that you didn’t want to mention cryptocurrency even a single time. I guess the grifters have realized they can’t use that term anymore lol.
MobileHelicopter1756@reddit
another scam from russian asset
eli_pizza@reddit
This seems like probably a bad idea to begin with, and tying it to sketchy crypto only makes it worse.
Square_Alps1349@reddit
Doesn’t this make it harder to maintain privacy standards if the hosting is truly decentralized? Like how do I know the host isn’t some CIA mega headquarters in disguise
eli_pizza@reddit
Or just someone with a home rig curious (or worse) about what their customers are promoting it with
SoggyYam9848@reddit
I'm excited to see this work. Even if you don't trust this guy, it's a great experiment for the rest of us to watch.
Betadoggo_@reddit
This is just vast with crypto tacked onto it. The TEE requirement is an interesting addition, but it means that the gpus won't really be distributed, they'll just be rented by different people from the same datacenters you would have otherwise rented from directly, which will make this comparatively more expensive. The oldest GPU to support TEE is the H100, so it won't feature any of the desirable consumer cards for spot inference, like the a100s and 90 class consumer card.
bigh-aus@reddit
I'm all for this - distributed compute (assuming you can solve the cross talk latency issue) is the better answer to crazy big datacenters.
Not_your_guy_buddy42@reddit
A 20-foot pole is not sufficient to touch this with
No_Palpitation7740@reddit (OP)
Link to the website https://cocoon.org/ and the tweet https://x.com/durov/status/1995208789600182391?t=Ivb6tpWzEB9R1cLSE01mQA&s=19