Skip to content
View original post on X: ZyphraOfficial
Published
42/100

Zyphra introduces ZYFA, an FP8 attention kernel for AMD MI355X

AIZyphra introduces Zyphra FlashAttention (ZYFA), an 8-bit floating-point attention kernel for AMD MI355X GPUs. Its prefill kernels deliver 1.16–1.76x the throughput of AMD's AITER inference kernel library on real model inputs at 16K tokens under sustained load.
ZyphraVerified on XOfficial
@ZyphraAI
View on X

Introducing Zyphra FlashAttention (ZYFA): faster, more accurate 8-bit floating-point (FP8) attention on AMD MI355X.

Our prefill kernels deliver 1.16–1.76x the throughput of AMD’s inference kernel library, AITER, on real model inputs at 16K tokens under sustained load. 🧵

Source details

Zyphra · x.comPublished · added here

Original title: Introducing Zyphra FlashAttention (ZYFA): faster, more accurate 8-bit floating-point (FP8) attention on AMD MI355X.

Topics

Deployment & engineeringProduct updates