Library/reasoning-from-scratch
Library/reasoning-from-scratchForked

rasbt/reasoning-from-scratch

reasoning-from-scratch

Implement a reasoning LLM in PyTorch from scratch, step by step

Builder

rasbt

rasbt

rasbt • individual

Stars

3,966

Using upstream star count

Forks

560

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Mar 4, 2025

Project creation date

README Summary

This repository provides a step-by-step implementation of a reasoning-capable Large Language Model (LLM) built from scratch using PyTorch. The tutorial walks through the complete process of creating and training a model that can perform logical reasoning tasks, presented in an educational Jupyter Notebook format.

AI Dev Skills

Unmapped

Large Language Model ArchitecturePyTorch Deep LearningReasoning Model ImplementationNeural Network TrainingTransformer ArchitectureLanguage Model Fine-tuningStep-by-step Model Development

Tags

Large Language Model ArchitecturePyTorch Deep LearningReasoning Model ImplementationNeural Network TrainingTransformer ArchitectureLanguage Model Fine-tuningStep-by-step Model DevelopmentEducationResearchEducational Tutorial for LLM DevelopmentResearch EnvironmentSelf-hostedLearning PyTorch for Language ModelsFrom-Scratch Model DevelopmentTextReasoning AIEducational AI ImplementationUnderstanding LLM Internal MechanismsResearch Implementation of Reasoning ModelsJupyter Notebook

Taxonomy

Recent Activity

Updated 27 days ago

7 Days

0

30 Days

0

90 Days

0

Quality

research
Quality
medium
Maturity
research

Categories

Foundation ModelsPrimaryModel TrainingLearning ResourcesData Science & AnalyticsSearch & KnowledgeOther AI / ML

PM Skills

Product Discovery

Languages

Jupyter Notebook100.0%

Timeline

Project created
Mar 4, 2025
Forked
Mar 12, 2026
Your last push
27 days ago
Upstream last push
6 days ago
Tracked since
Mar 17, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…