LiteRT in Google Play services is Android’s on-device inference runtime for custom models, handling more than a trillion inferences a day across billions of devices. Today, it gets itsbiggest upgrade yet:GPU inference that runs about 1.4x faster than the legacy GPU delegate, powered by ML Drift and available through the new CompiledModel API, LiteRT’s modern…
