Library/firecrawl
Library/firecrawlForked

firecrawl/firecrawl

firecrawl

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

Builder

firecrawl

firecrawl

firecrawl • individual

Stars

103,250

Using upstream star count

Forks

6,787

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Apr 15, 2024

Project creation date

README Summary

Firecrawl is a web scraping API that converts websites into clean markdown or structured data optimized for AI and LLM consumption. It offers simple API endpoints to crawl single pages or entire websites, handling JavaScript rendering, rate limiting, and data cleaning automatically. The service provides both hosted and self-hosted options with SDKs for multiple programming languages.

AI Dev Skills

Unmapped

Web Data ExtractionData Preprocessing for LLMsContent NormalizationAPI DevelopmentWeb Scraping ArchitectureData Pipeline EngineeringRetrieval-Augmented Generation Data Preparation

Tags

Web Data ExtractionData Preprocessing for LLMsContent NormalizationAPI DevelopmentWeb Scraping ArchitectureData Pipeline EngineeringRetrieval-Augmented Generation Data PreparationServerlessData-Centric AILLM Training Data CollectionWeb Content MonitoringContent ManagementMarketing TechnologyRetrieval-Augmented GenerationWebsite Content AnalysisTextAI/ML InfrastructureSEO AnalysisCompetitive Intelligence GatheringRAG System Data IngestionLLM Data PipelinesContent MigrationDeveloper ToolsSelf-hostedImageMultimodalData AnalyticsDockerCompound AI SystemsCloud APITypeScript

Taxonomy

Recent Activity

Updated 23 days ago

7 Days

0

30 Days

0

90 Days

0

Quality

production
Quality
high
Maturity
production

Categories

MLOps & InfrastructurePrimaryDev Tools & AutomationRAG & RetrievalEvals & BenchmarkingObservability & MonitoringML Platform & InfrastructureData Science & AnalyticsMultimodal AIOther AI / MLModel TrainingFoundation Models

PM Skills

Scale & ReliabilityDeveloper Platform

Languages

TypeScript100.0%

Timeline

Project created
Apr 15, 2024
Forked
Mar 22, 2026
Your last push
23 days ago
Upstream last push
6 days ago
Tracked since
Mar 21, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…