Skip to content
Google Developers Blog·· YesterdayPickAI score62

Google open-sources ML Drift, a cross-platform GPU engine for on-device AI

ML Drift: Next-Gen GPU AI/ML Inference at the Edge

AI summary

Google's AI Edge Team open-sourced ML Drift under Apache 2.0, a GPU compute engine for on-device AI inference across OpenGL ES, OpenCL, Metal, and WebGPU. It serves as the core GPU acceleration engine within LiteRT and succeeds the legacy TFLite GPU delegate, which will no longer receive new features. The post cites benchmarks showing up to 40% lower frame latency in YouTube Shorts and up to 30% faster on-device performance in Adobe Lightroom and Photoshop.

Why it matters

The post explains how ML Drift unifies GPU shaders across platforms and replaces the TFLite GPU delegate, which matters for developers deploying on-device models.

Source: Google Developers Blog · developers.googleblog.com