⬢github TechnologyAI first seen 3 h ago, last 13 min ago, peak #3
NVIDIA/Model-Optimizer
NVIDIA/Model-Optimizer is an open-source Python library on GitHub that collects state-of-the-art model optimization techniques, including quantization, distillation, pruning, neural architecture search and speculative decoding. It compresses deep learning models so they run efficiently in deployment frameworks such as TensorRT-LLM, TensorRT and vLLM, improving inference speed. It is trending on GitHub's rankings with modest engagement, and the posts shown only describe the project itself, so there is no evidence of a specific event driving attention.
Why now: unclear
NVIDIAModel-OptimizerTensorRT-LLMvLLMTensorRT
Rank over time, top of the chart is #1. 31 snapshots from 3 h ago to 13 min ago.
Evidence
- NVIDIA/Model-Optimizer · NVIDIA · 16
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize…