Skip to content
View original post on X: vLLMOfficial· 41/100AI score41/100

vLLM-Omni adds day-0 support for FLUX 3 Image Klein

AISummary

vLLM-Omni now supports FLUX 3 Image Klein image generation from the day of its release, developed with Black Forest Labs and NVIDIA. The integration supports BF16, FP8 and NVFP4 checkpoint formats, with custom kernels optimizing the transformer and text encoder. A Docker image tagged flux-3-image-klein and a deployment recipe are available.

Post on XView on X
vLLMVerified on X
@vllm_project

🎉 Day-0 support for FLUX 3 Image Klein is here in vLLM-Omni!

We worked with Black Forest Labs and NVIDIA to bring the new image-model release to the vLLM-Omni serving stack.

What the integration brings:
🎨 FLUX 3 Image Klein image generation
⚡ BF16, FP8 and NVFP4 checkpoint formats
🛠️ Custom kernels, with optimizations across the transformer and text encoder
📦 Hugging Face model-path handling for the text encoder and autoencoder

Thanks to Black Forest Labs, NVIDIA and the vLLM-Omni community for the collaboration.

Docker image:
docker pull vllm/vllm-omni:flux-3-image-klein

Explore vLLM-Omni:
https://github.com/vllm-project/vllm-omni

Deployment recipe:
https://recipes.vllm.ai/black-forest-labs/flux-3-image-klein

Source: vLLM · x.comPublished

Topics

Image generationOpen-source ecosystemDeployment & engineeringProduct updates