Skip to content
@neuralmagic

Neural Magic

Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM

Pinned Loading

  1. deepsparse deepsparse Public archive

    Sparsity-aware deep learning inference runtime for CPUs

    Python 3.2k 193

Repositories

Showing 10 of 108 repositories
  • model-validation-configs Public
    neuralmagic/model-validation-configs's past year of commit activity
    2 2 1 9 Updated Sep 15, 2026
  • crucible Public

    Crucible: an autonomous goal-directed research loop engine

    neuralmagic/crucible's past year of commit activity
    Rust 8 Apache-2.0 3 4 9 Updated Sep 15, 2026
  • vllm-vcr Public

    vLLM inference simulator and replay machine

    neuralmagic/vllm-vcr's past year of commit activity
    Rust 6 Apache-2.0 1 14 (2 issues need help) 11 Updated Sep 15, 2026
  • vllm Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    neuralmagic/vllm's past year of commit activity
    Python 17 Apache-2.0 22,457 0 38 Updated Sep 15, 2026
  • vllm-beam-search-plugin Public

    Beam search scheduler plugin for vLLM v1 with CoW block table forking

    neuralmagic/vllm-beam-search-plugin's past year of commit activity
    Python 3 Apache-2.0 1 1 0 Updated Sep 15, 2026
  • nm-vllm-omni-ent Public Forked from vllm-project/vllm-omni

    A framework for efficient model inference with omni-modality models

    neuralmagic/nm-vllm-omni-ent's past year of commit activity
    Python 3 Apache-2.0 1,767 0 1 Updated Sep 14, 2026
  • vllm-openshift-recipes Public
    neuralmagic/vllm-openshift-recipes's past year of commit activity
    0 0 0 2 Updated Sep 13, 2026
  • llm-manifesto Public

    Declarative Kubernetes renderer for llm-d and vLLM deployments

    neuralmagic/llm-manifesto's past year of commit activity
    Python 2 Apache-2.0 0 0 2 Updated Sep 11, 2026
  • gpu-pruner Public

    Non-destructive GPU based idle-culler for RHOAI/Kubeflow workloads

    neuralmagic/gpu-pruner's past year of commit activity
    Rust 6 MIT 4 0 3 Updated Sep 11, 2026
  • inspect_evals Public Forked from UKGovernmentBEIS/inspect_evals

    Collection of evals for Inspect AI

    neuralmagic/inspect_evals's past year of commit activity
    Python 0 MIT 444 0 7 Updated Sep 9, 2026
View all repositories