LLMs From Scratch
Build a ChatGPT-like LLM in PyTorch step by step
Open models, training, fine-tuning, inference engines and ML research code.
Build a ChatGPT-like LLM in PyTorch step by step
Train a tiny language model from scratch on regular hardware
Learn to build, deploy and iterate production ML apps
Local voice cloning and expressive text-to-speech
Runs huge models on small GPUs by streaming layers
Pretrained foundation model for forecasting numeric time-series data
Bare-bones NumPy implementations of core ML algorithms
Python-like language with C-level performance for AI code
Run small language models locally on phones and computers
Real-time 3D scene reconstruction from camera frames
General-purpose physics simulator for robotics and control research
Open world models and datasets for robots and physical AI
Tiny special-purpose models that run locally on everyday devices
Long-document OCR with sliding-window attention