Library/scrapling
Library/scraplingForked

D4Vinci/Scrapling

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Builder

D4Vinci

D4Vinci

D4Vinci • individual

Stars

34,484

Using upstream star count

Forks

2,817

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Oct 13, 2024

Project creation date

README Summary

Scrapling is an adaptive web scraping framework for Python that provides a unified interface for handling everything from single requests to full-scale crawling operations. It offers features like automatic proxy rotation, JavaScript rendering, rate limiting, and robust error handling. The framework aims to simplify web scraping by providing intelligent defaults while remaining highly configurable for complex scraping scenarios.

AI Dev Skills

Unmapped

Web Data ExtractionHTTP Client ProgrammingBrowser AutomationAnti-Bot EvasionHTML/DOM ParsingJavaScript Rendering

Tags

Web Data ExtractionHTTP Client ProgrammingBrowser AutomationAnti-Bot EvasionHTML/DOM ParsingJavaScript RenderingReal EstateContent AggregationNews ScrapingE-commerceXMLCompetitive IntelligenceData Pipeline AutomationCloud APIMarket ResearchSelf-hostedLead GenerationPrice MonitoringMarket Research Data CollectionFinancial ServicesSEO AnalysisProduct Catalog ExtractionNews MediaHTMLAcademic ResearchOn-premiseJSONTextAgentic AIPython

Taxonomy

Recent Activity

Updated 27 days ago

7 Days

0

30 Days

0

90 Days

0

Quality

beta
Quality
medium
Maturity
beta

Categories

MLOps & InfrastructurePrimaryDev Tools & AutomationLearning ResourcesObservability & MonitoringNLP & TextML Platform & InfrastructureSearch & KnowledgeOther AI / MLAI Agents

PM Skills

Scale & ReliabilityDeveloper Platform

Languages

Python100.0%

Timeline

Project created
Oct 13, 2024
Forked
Mar 12, 2026
Your last push
27 days ago
Upstream last push
6 days ago
Tracked since
Mar 17, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…