⬢github C++ · 113 ★ +1 since we first saw it · pushed 3 d ago · AGPL-3.0
General-Instinct/InstinctFlash
High-Performance Serving Runtime for Robotics Models
InstinctFlash is an open-source C++/Python serving runtime that accelerates robotics model inference. It supports eight model families (VLA, pi05, GR00T, Cosmos, DreamZero, etc.), applies FP8 and sampling optimizations, and reports large speedups over PyTorch on Jetson Thor and consumer RTX 4090/5090 GPUs, with a one-command `serve` entry point for fine-tuned checkpoints.
Why now: Launched via a Show HN post alongside a full-source release and fresh Jetson Thor benchmarks claiming up to 33.78× speedups.
Who it is for: Robotics engineers deploying vision-language-action or diffusion policies on edge hardware like Jetson Thor or desktop RTX GPUs.
Stars over our 24 snapshots: 113 to 113, since 4 h ago.
Where people talked about it
API: https://socialmediatrends-api.osmike.com/v1/repos/General-Instinct/InstinctFlash