RepoRadar
Leave a Tip
Item detail

antirez/ds4

ds4 is an MIT-licensed local inference engine for DeepSeek 4 Flash and Pro, written in C by Salvatore Sanfilippo (the creator of Redis), and shipping native backends for Metal, CUDA, and ROCm in a single binary. It is the first serious local-engine answer to DeepSeek 4, and the author is one of the few people in the world with a track record of shipping high-performance systems code that people ac

Open source →Back to radar
Score8.6
Popularity92.0
Risknone
TierGold
Score breakdown
Usefulness8.0
Novelty9.0
Momentum9.0
Maturity8.6
Open-source/build8.4
Evidence7.2
Workflow potential9.7
Setup ease6.4

Popularity is tracked separately. Support, ads, sponsorships, and tips never affect these signals.

Why it matters

Useful for developers who want to run DeepSeek 4 on their own hardware without going through llama.cpp, vLLM, or a hosted API: clone ds4, point it at a model file, and run a small prompt locally to confirm the speed/quality bar before integrating it into a real product.

Who should use it

local AI enthusiasts running DeepSeek 4 on Apple Silicon or consumer GPUsdeveloper-tools authors who need a small, embeddable inference binaryinfrastructure teams that want a DeepSeek 4 path without adopting llama.cpptinkerers who follow antirez's work

Who should skip it

Skip if the source link, docs, or setup requirements do not match your workflow.

Risk explanation

new engine on a new model family; expect rough edges around tool calling, batching, and quant formats until the 1.0.

Evidence links

Closest alternatives / related signals

inferencedeepseekmetalcudarocmlocal-aiantirezds4