runtimelab▮
Sign in

~/runtimelab $ cat ./llm/README

Build an LLM (from scratch)

Build a GPT-style language model from scratch — tokenizer, attention, training, and sampling, from raw tokens to generated text. Deterministic and verified end to end.

stages
25
estimated
25–40 h
level
Advanced
track
AI/ML Engineering
language
Python
  • tokenization
  • self-attention
  • transformer blocks
  • pretraining
  • classification finetuning
  • instruction tuning
Sign in to startBrowse all challenges

The stage list opens once you sign in — it is the challenge, not the pitch. Signing in is free, and the first stages of every challenge are too.