Hy-SimulMT brings open Chinese-English simultaneous translation to live speech, translating as the speaker talks with text and speech output.
🤖 https://modelscope.ai/collections/Tencent-Hunyuan/Hy-SimulMT
⚡ Low latency, strong quality: In the team’s RealSI long-form evaluation, Hy-SimulMT records the lowest StreamLAAL among the compared systems while surpassing the compared open models and four of five commercial APIs on GEMBA quality.
🗣️ Speech-to-speech in both directions: Translate Chinese to English or English to Chinese continuously, with real-time voice cloning to help preserve each speaker’s vocal identity.
🔁 Choose the output workflow: Use the standard checkpoint for translation-only output, or the Interleave variant to receive source text alongside the translation.
🛠️ Ready to build with: FP8 and GGUF variants are available alongside SimulInfer deployment and SimulTrain training tools.
📜 Apache-2.0 License. Speech output and voice cloning require a configured TTS service.