Google open-sources ML Drift, the GPU engine behind LiteRT

Google's AI Edge team has open-sourced ML Drift under Apache 2.0, a cross-platform GPU compute engine for on-device AI inference. It abstracts OpenGL ES, OpenCL, Metal and WebGPU, supports 5D tensors, and already runs in Chrome, YouTube Shorts, Photos and Meet.

• ML Drift runs in production on millions of devices in Chrome, YouTube Shorts and Photos
• Adds 5D tensor support and tensor virtualization across GPU backends
• Used up to 12% less memory than other frameworks in Gemma benchmarks
• The legacy TFLite GPU delegate is frozen; Google recommends migrating to LiteRT