rasbt/reasoning-from-scratch
reasoning-from-scratch
Implement a reasoning LLM in PyTorch from scratch, step by step
Builder

rasbt
rasbt • individual
Stars
3,966
Using upstream star count
Forks
560
Using upstream fork count
Open Issues
0
Activity Score
0/100
0 commits in 30d
Created
Mar 4, 2025
Project creation date
README Summary
This repository provides a step-by-step implementation of a reasoning-capable Large Language Model (LLM) built from scratch using PyTorch. The tutorial walks through the complete process of creating and training a model that can perform logical reasoning tasks, presented in an educational Jupyter Notebook format.
AI Dev Skills
Unmapped
Large Language Model ArchitecturePyTorch Deep LearningReasoning Model ImplementationNeural Network TrainingTransformer ArchitectureLanguage Model Fine-tuningStep-by-step Model Development
Tags
Large Language Model ArchitecturePyTorch Deep LearningReasoning Model ImplementationNeural Network TrainingTransformer ArchitectureLanguage Model Fine-tuningStep-by-step Model DevelopmentEducationResearchEducational Tutorial for LLM DevelopmentResearch EnvironmentSelf-hostedLearning PyTorch for Language ModelsFrom-Scratch Model DevelopmentTextReasoning AIEducational AI ImplementationUnderstanding LLM Internal MechanismsResearch Implementation of Reasoning ModelsJupyter Notebook
Taxonomy
Deployment Context
Modalities
Skill Areas
Recent Activity
Updated 27 days ago
7 Days
0
30 Days
0
90 Days
0
Quality
research- Quality
- medium
- Maturity
- research
Categories
Foundation ModelsPrimaryModel TrainingLearning ResourcesData Science & AnalyticsSearch & KnowledgeOther AI / ML
PM Skills
Product Discovery
Languages
Jupyter Notebook100.0%
Timeline
- Project created
- Mar 4, 2025
- Forked
- Mar 12, 2026
- Your last push
- 27 days ago
- Upstream last push
- 6 days ago
- Tracked since
- Mar 17, 2026
Similar Repos
pgvector cosine similarity · $0
Loading…