Reporium
GraphWikiTaxonomyStacksInsightsTrendsArchitectureAI-NativeFAQ
Ask anything about the repo library…
Loading repo…
←Library/reasoning-from-scratch
Library/reasoning-from-scratchForked

rasbt/reasoning-from-scratch

reasoning-from-scratch

Implement a reasoning LLM in PyTorch from scratch, step by step

View on GitHub↗Upstream rasbt/reasoning-from-scratch↗

Builder

rasbt

rasbt

rasbt • individual

Stars

4,417

Using upstream star count

Forks

644

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Mar 4, 2025

Project creation date

README Summary

This repository contains the code for developing an LLM reasoning model and is the official code repository for the book [*Build a Reasoning Model (From Scratch)*](https://mng.bz/lZ5B).

Community Evaluation

Loading…

AI Dev Skills

Unmapped

Language Model Fine-tuningLarge Language Model ArchitectureNeural Network TrainingPyTorch Deep LearningReasoning Model ImplementationStep-by-step Model DevelopmentTransformer Architecture

Tags

Language Model Fine-tuningLarge Language Model ArchitectureNeural Network TrainingPyTorch Deep LearningReasoning Model ImplementationStep-by-step Model DevelopmentTransformer ArchitectureDeepSeekDistillationEvalsForkedGRPOJupyterLarge Language ModelsMMLUOllamaOpenAIPlanning / CoTPyTorchPythonReasoning ModelsReinforcement Learning

Taxonomy

AI Trends

Reasoning AIEducational AI ImplementationFrom-Scratch Model Development

category

Foundation ModelsAI AgentsModel TrainingEvals & BenchmarkingInference & ServingData Science & Analytics

Deployment Context

Self-hostedResearch Environment

Industries

EducationResearch

Modalities

Text

Skill Areas

Large Language Model ArchitecturePyTorch Deep LearningReasoning Model ImplementationNeural Network TrainingTransformer ArchitectureLanguage Model Fine-tuningStep-by-step Model Development

tag

DeepSeekDistillationEvalsForkedGRPOJupyterLarge Language ModelsMMLUOllamaOpenAIPlanning / CoTPyTorchPythonReasoning ModelsReinforcement Learning

Use Cases

Educational Tutorial for LLM DevelopmentResearch Implementation of Reasoning ModelsLearning PyTorch for Language ModelsUnderstanding LLM Internal Mechanisms

Recent Activity

Updated 2 months ago

7 Days

0

30 Days

0

90 Days

16

Sync with PDF (#211)

Sebastian Raschka • Mar 13, 2026

5023074

torch.inference_mode() (#210)

Sebastian Raschka • Mar 13, 2026

418d647

Exact instructions for generation the 12k dataset (#209)

Sebastian Raschka • Mar 12, 2026

d16a6e2

Quality

research
Quality
medium
Maturity
research

Categories

Evals & BenchmarkingPrimaryInference & ServingData Science & AnalyticsFoundation ModelsAI AgentsModel TrainingOther AI / ML

PM Skills

Data & EvaluationAI-Native Architecture

Languages

Jupyter Notebook100.0%

Timeline

Project created
Mar 4, 2025
Forked
Mar 12, 2026
Your last push
2 months ago
Upstream last push
16 days ago
Tracked since
Mar 17, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…