TheaterFire

DeepSeek will open-source parts of its inference engine — sharing standalone features and optimizations instead of the full stack

Posted by eck72@reddit | LocalLLaMA | View on Reddit | 11 comments

Reply to Post

11 Comments

Luston03@reddit

When I see deepseek release something open source I feel angry after remembering OpenAI aka (Only for Private Enterprise Needs Ai) didn't release any Open Source except some useless bench tools
View on Reddit #54104200

RiseStock@reddit

This is China spreading its soft power. The US used to be this competent.
View on Reddit #53725271

BlipOnNobodysRadar@reddit

The pro-capitalism leaving my body when a Chinese quant firm releases the best open source AI https://preview.redd.it/xukelyjdwxue1.jpeg?width=2100&format=pjpg&auto=webp&s=d2cd9921d56eec03a4237f6c99958981b79e2272
View on Reddit #53798395

Immediate-Rhubarb135@reddit

Would love to have NSA open-sourced.
View on Reddit #53740394

gpupoor@reddit

a shame they aren't open sourcing the whole engine, but nonetheless they are angels
View on Reddit #53714362

randomrealname@reddit

The title is misleading. There is no point in releasing the full stack, it won't work unless your hardware is configured exactly like thiers. I mean exactly. They built it from the ground up. Most of that ia useless. What they are doing instead is realizing sections that are more standard. Meaning you can actually use it. They stated this in the paper if you read it.
View on Reddit #53739726

CptKrupnik@reddit

Anything the we can take away from there right now for personal projects?
View on Reddit #53716252

BreakfastFriendly728@reddit

thanks to real openai
View on Reddit #53714512

Zalathustra@reddit

The title is kinda misleading, and makes it sound like they're only releasing parts of their stack, while keeping some parts private. What they're actually doing is *better* than dropping the full stack: instead of just dropping their highly specific, customized stack, they're working on getting the optimizations ported to popular open source inference engines. This means we're getting DS optimizations in vLLM, and likely llama.cpp, kobold, etc. as well.
View on Reddit #53714255

LagOps91@reddit

that's great news! here is to hoping we can get some better inference performance out of this.
View on Reddit #53712361

Nexter92@reddit

We didn't not diserve those goats 🫠
View on Reddit #53711397