Skip to content
View original post on X: ZyphraOfficial
Published
28/100

Zyphra adds GLM-5.3-Flash to Zyphra Inference on AMD MI300X

AIZyphra says GLM-5.3-Flash from Z.ai is now served on Zyphra Inference using its Zyphra Optimization Engine (ZOE) on AMD Instinct MI300X. Zyphra claims ZOE makes p90 generation 3.1x faster per user and p90 time to first token 10.7x lower than stock SGLang.
ZyphraVerified on XOfficial
@ZyphraAI
View on X

GLM-5.3-Flash from @zai_org is on Zyphra Inference, served with the Zyphra Optimization Engine (ZOE) on @AMD Instinct MI300X.

With ZOE, p90 generation is 3.1x faster per user and p90 time to first token is 10.7x lower than stock SGLang.

Try it at: https://cloud.zyphra.com

Source details

Zyphra · x.comPublished · added here

Original title: GLM-5.3-Flash from @zai_org is on Zyphra Inference, served with the Zyphra Optimization Engine (ZOE) on @AMD Instinct MI300X.

Topics

Deployment & engineeringChina AIProduct updates