Library/LiteRTForked

google-ai-edge/LiteRT

LiteRT

LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization

View on GitHub↗Upstream google-ai-edge/LiteRT↗

Builder

google-ai-edge

google-ai-edge • individual

Stars

2,035

Using upstream star count

Forks

257

Using upstream fork count

Open Issues

Activity Score

0/100

0 commits in 30d

Created

Sep 4, 2024

Project creation date

README Summary

LiteRT is Google's successor to TensorFlow Lite, designed as an on-device framework for high-performance machine learning and generative AI deployment on edge platforms. It provides efficient conversion, runtime, and optimization capabilities for running ML models directly on devices rather than in the cloud. The framework is built primarily in C++ and focuses on enabling fast inference on resource-constrained edge devices.

AI Dev Skills

Unmapped

Tags

On-device Machine LearningModel Optimization and QuantizationEdge AI DeploymentMobile ML InferenceGenerative AI OptimizationNeural Network CompressionCross-platform ML RuntimeModel Conversion and SerializationHardware Acceleration IntegrationEmbedded Systems MLEmbedded System AI IntegrationOn-deviceReal-time Image Classification on MobileMultimodalConsumer ElectronicsOffline AI Model InferenceIoT and Embedded SystemsRoboticsSmart HomeTextMobile AIMobile Generative AI ApplicationsEdge-based Natural Language ProcessingAutomotiveTabularIoT Device IntelligenceWearable TechnologyEdge/MobileEdge ComputingImageIoT DevicesMobile ApplicationsOn-device AIMobile Computer Vision ApplicationsAudioModel CompressionEfficient AI InferenceVideoHealthcare DevicesOn-device Speech RecognitionEmbedded SystemsC++

Taxonomy

AI Trends

On-device AI Edge Computing Model Compression Mobile AI Generative AI Optimization Efficient AI Inference

Deployment Context

Edge/Mobile Embedded Systems On-device IoT Devices

Industries

Mobile Applications IoT and Embedded Systems Automotive Healthcare Devices Consumer Electronics Robotics Smart Home Wearable Technology

Modalities

Image Audio Text Video Tabular Multimodal

Skill Areas

Use Cases

Real-time Image Classification on Mobile On-device Speech Recognition Mobile Computer Vision Applications Edge-based Natural Language Processing Offline AI Model Inference Embedded System AI Integration Mobile Generative AI Applications IoT Device Intelligence

Recent Activity

Updated 1 months ago

7 Days

30 Days

90 Days

Quality

production

Quality: high
Maturity: production

PM Skills

Developer Platform

Languages

C++100.0%

Timeline

Project created: Sep 4, 2024
Forked: Mar 13, 2026
Your last push: 1 months ago
Upstream last push: 6 days ago
Tracked since: Mar 13, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…