NeuralMagic

Neural Magic was an AI software company that spun out of MIT in 2018 to build high-performance deep learning inference software. Its flagship open-source products were DeepSparse, a sparsity-aware inference runtime delivering GPU-class performance on commodity CPUs, together with SparseML, SparseZoo, and Sparsify for model compression, sparsification recipes, and a curated model repository, plus nm-vllm, an enterprise LLM inference server for GPUs. Neural Magic was a prolific contributor to the community vLLM project. The company was acquired by Red Hat (agreement announced November 2024, completed January 2025) and its engineering now advances vLLM and Red Hat AI. The community versions of DeepSparse, SparseML, SparseZoo, and Sparsify were deprecated on 2026-06-02. Neural Magic exposed no commercial REST API; its developer surface was a set of first-party Python libraries published to PyPI and open source on GitHub.

NeuralMagic is profiled on the APIs.io network. Tagged areas include Company, Artificial Intelligence, Machine Learning, Inference, and LLM.

NeuralMagic’s developer surface includes documentation and 4 more developer resources.

🌐 Visit website 📡 Source on GitHub
10.5/100 minimal ▬ flat Agent 0/100 human only Full breakdown ↓
scored 2026-07-27 · rubric v0.5
0 APIs
CompanyArtificial IntelligenceMachine LearningInferenceLLMModel CompressionOpen SourcePythonvLLMDeep Learning

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-07-27 · rubric v0.5
Composite quality — 10.5/100 · minimal
Contract Quality 0.0 / 25
Developer Ergonomics 3.0 / 20
Commercial Clarity 0.0 / 20
Operational Transparency 0.7 / 13
Governance 0.0 / 12
Discoverability 6.8 / 10
Agent readiness — 0/100 · human only
Machine-Readable Contract 0 / 18
Agentic Access Contract 0 / 15
MCP Server 0 / 12
Machine-Readable Auth 0 / 10
Idempotency 0 / 9
Stable Error Semantics 0 / 8
Request/Response Examples 0 / 7
Rate-Limit Signaling 0 / 7
Typed Event Surface 0 / 6
Agent Skills 0 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/neuralmagic: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

Resources

Documentation 1

Reference material describing how the API behaves

Documentation
Documentation

Build 4

SDKs, sample code, and the tooling you integrate with

Packages
Packages
 SDKs
SDKs
 GitHubOrganization
GitHubOrganization
 SourceCode
SourceCode

Source (apis.yml)

apis.yml Raw ↑ 
aid: neuralmagic
name: NeuralMagic
description: Neural Magic was an AI software company that spun out of MIT in 2018 to build high-performance deep learning
  inference software. Its flagship open-source products were DeepSparse, a sparsity-aware inference runtime delivering GPU-class
  performance on commodity CPUs, together with SparseML, SparseZoo, and Sparsify for model compression, sparsification recipes,
  and a curated model repository, plus nm-vllm, an enterprise LLM inference server for GPUs. Neural Magic was a prolific contributor
  to the community vLLM project. The company was acquired by Red Hat (agreement announced November 2024, completed January
  2025) and its engineering now advances vLLM and Red Hat AI. The community versions of DeepSparse, SparseML, SparseZoo, and
  Sparsify were deprecated on 2026-06-02. Neural Magic exposed no commercial REST API; its developer surface was a set of
  first-party Python libraries published to PyPI and open source on GitHub.
url: https://raw.githubusercontent.com/api-evangelist/neuralmagic/refs/heads/main/apis.yml
accessModel:
  pricing: unknown
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Unknown
  confidence: low
  source: []
  generated: '2026-07-22'
  method: derived
image: https://avatars.githubusercontent.com/u/68670575?v=4
x-type: company
x-source: vc-portfolio
x-backed-by:
- a16z
x-tier: stub
x-tier-reason: portfolio-lead
x-status: acquired
x-acquired-by: Red Hat
specificationVersion: '0.20'
created: '2026-07-17'
modified: '2026-07-20'
tags:
- Company
- Artificial Intelligence
- Machine Learning
- Inference
- LLM
- Model Compression
- Open Source
- Python
- vLLM
- Deep Learning
apis: []
common:
- type: Packages
  url: packages/neuralmagic-packages.yml
  name: Neural Magic Python packages (deprecated)
- type: SDKs
  url: packages/neuralmagic-packages.yml
  name: Neural Magic first-party Python libraries
- type: GitHubOrganization
  url: https://github.com/neuralmagic
  name: Neural Magic on GitHub
- type: Documentation
  url: https://github.com/neuralmagic/docs
  name: Neural Magic documentation (archived)
- type: SourceCode
  url: https://github.com/neuralmagic/deepsparse
  name: DeepSparse source code
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
x-enrichment:
  date: '2026-07-20'
  status: enriched
  artifacts_added: 1
  pass: local-v1