RLinf adds Cosmos3 support with SGLang, boosting evaluation throughput 3.33x
Original title🚀 New blog: Cosmos3 in RLinf: 3.33× End-to-End Evaluation Throughput with SGLang
AISummary
RLinf, an open-source framework for embodied intelligence and AI agents, now supports Cosmos3 from fine-tuning through robot evaluation.
With SGLang inference, it delivers 3.33x end-to-end evaluation throughput, batching inference for 128 parallel environments on 8 GPUs across 500 episodes of the full LIBERO-10 evaluation.
RLinf also overlaps CPU simulation with GPU inference to reduce waiting between stages.
Source: LMSYS Org · x.comPublished · added here