vLLM adds day-0 support for Recursive's Flint model on a single GPU
AIvLLM supports Recursive's Flint from day 0, and both its NVFP4 and BF16 checkpoints run on a single GB200 GPU. A single request decodes at about 500 tokens/s with 100K tokens of context. The post lists serving commands and details the kernel changes that cut NVFP4 decode time from 4.81 ms to 1.78 ms per step.
Source details
vLLM Blog · Inferact and Recursive · vllm.aiPublished · added here
Original title: Day-0 Support for Flint on vLLM