Google moves LiteRT into Play services for faster on-device GPU inference
AIGoogle says LiteRT in Google Play services runs GPU inference about 1.4x faster than the legacy TensorFlow Lite GPU delegate through the new CompiledModel API. In Google's testing, apps that switched to the Play services runtime were about 8 MB smaller because the runtime ships once with Play services rather than inside each app. The post also notes that the legacy GPU delegate and NNAPI are deprecated, with NNAPI to be removed starting in 2027.
Source details
Google Developers Blog · developers.googleblog.comPublished · added here
Original title: Smaller apps and faster GPU inference with LiteRT in Google Play services