Back to all repositories
NV
Model-Optimizer
by NVIDIA
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
3,732stars579forks31watchers/subscribers385issues
- Language
- Python
- License
- Apache License 2.0
- Size
- 118.6 MB
- Created
- Apr 23, 2024
- Last Updated
- Sep 4, 2026
- Last Pushed
- Sep 4, 2026
Available Plugins
Loading plugins...
Evaluate before installing
- Review the source repository, recent maintenance, and license on GitHub.
- Read the marketplace manifest and plugin source files before running commands.
- Start with the smallest required permission set and validate behavior in a safe environment.