Library/airioForked

google/airio

airio

AirIO is a library for building scalable data preprocessing pipelines for machine learning, particularly focused on text-to-text tasks.

View on GitHub↗Upstream google/airio↗

Builder

Google

google • big-tech

Stars

Using upstream star count

Forks

Using upstream fork count

Open Issues

Activity Score

0/100

0 commits in 30d

Created

Jul 13, 2023

Project creation date

README Summary

AirIO is a library for building scalable data preprocessing pipelines for machine learning, particularly focused on text-to-text tasks. It provides a flexible framework for data loading, preprocessing, and batching with support for various data sources and transformations. The library is designed to work seamlessly with JAX and other ML frameworks for efficient model training.

AI Dev Skills

Unmapped

Data Pipeline EngineeringMachine Learning InfrastructureData PreprocessingML Training Pipelines

Taxonomy

AI Trends

ML Infrastructure Optimization

Deployment Context

Cloud Self-hosted

Modalities

Text

Skill Areas

Data Pipeline Engineering Machine Learning Infrastructure Data Preprocessing ML Training Pipelines

Use Cases

ML Data Pipeline Management Training Data Preprocessing Model Input Pipeline Optimization

Recent Activity

Updated 1 months ago

7 Days

30 Days

90 Days

Quality

research

Quality: low
Maturity: research

PM Skills

Scale & ReliabilityDeveloper Platform

Languages

Python100.0%

Timeline

Project created: Jul 13, 2023
Forked: Mar 13, 2026
Your last push: 1 months ago
Upstream last push: 1 months ago
Tracked since: Mar 9, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…