Reporium
GraphWikiTaxonomyStacksInsightsTrendsArchitectureAI-NativeFAQ
Ask anything about the repo library…
Loading repo…
←Library/gpt-crawler
Library/gpt-crawlerForked

BuilderIO/gpt-crawler

gpt-crawler

Crawl a site to generate knowledge files to create your own custom GPT from a URL

View on GitHub↗Upstream BuilderIO/gpt-crawler↗

Builder

BuilderIO

BuilderIO

BuilderIO • individual

Stars

22,238

Using upstream star count

Forks

2,372

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Nov 14, 2023

Project creation date

README Summary

<!-- Keep these links. Translations will automatically update with the README. --> [Deutsch](https://www.readme-i18n.com/BuilderIO/gpt-crawler?lang=de) | [Español](https://www.readme-i18n.com/BuilderIO/gpt-crawler?lang=es) | [français](https://www.readme-i18n.com/BuilderIO/gpt-crawler?lang=fr) | [日本語](https://www.readme-i18n.com/BuilderIO/gpt-crawler?lang=ja) | [한국어](https://www.readme-i18n.com/BuilderIO/gpt-crawler?lang=ko) | [Português](https://www.readme-i18n.com/BuilderIO/gpt-crawler?la

Community Evaluation

Loading…

AI Dev Skills

Unmapped

Custom GPT DevelopmentData Pipeline EngineeringData PreprocessingKnowledge Base CreationText Extraction and ProcessingWeb Scraping

Tags

Custom GPT DevelopmentData Pipeline EngineeringData PreprocessingKnowledge Base CreationText Extraction and ProcessingWeb ScrapingAPIDockerForkedNode.jsOpenAI

Taxonomy

AI Trends

Custom GPT DevelopmentDomain-Specific AIKnowledge AugmentationAI Training Data Creation

category

Dev Tools & AutomationFoundation ModelsMLOps & Infrastructure

Deployment Context

Self-hostedCLI ToolLocal Development

Industries

Developer ToolsContent ManagementKnowledge ManagementEdTech

Modalities

TextHTML

Skill Areas

Web ScrapingData PreprocessingCustom GPT DevelopmentKnowledge Base CreationText Extraction and ProcessingData Pipeline Engineering

tag

APIDockerForkedNode.jsOpenAI

Use Cases

Custom GPT Training Data GenerationWebsite Knowledge Base CreationContent Extraction for AI TrainingDomain-Specific Chatbot DevelopmentDocumentation Processing for AI Models

Recent Activity

Updated 11 months ago

7 Days

0

30 Days

0

90 Days

0

Quality

prototype
Quality
medium
Maturity
prototype

Categories

Dev Tools & AutomationPrimaryMLOps & InfrastructureFoundation ModelsOther AI / ML

PM Skills

Scale & ReliabilityDeveloper Platform

Languages

TypeScript100.0%

Timeline

Project created
Nov 14, 2023
Forked
Mar 23, 2026
Your last push
11 months ago
Upstream last push
11 months ago
Tracked since
Jul 7, 2025

Similar Repos

pgvector cosine similarity · $0

Loading…