transformers

AWS and DeepLearning.ai's hands-on course on building with LLMs — covering transformer architecture, pre-training, fine-tuning, RLHF, and deploying generative AI applications at scale.

The definitive technical guide to building generative AI models — covering VAEs, GANs, diffusion models, transformers, and large language models from scratch.

Karpathy builds a GPT model from scratch in Python/PyTorch, live on camera — from the basic bigram model all the way to a working transformer with self-attention. The clearest hands-on explanation of how GPT architectures actually work.

A 3.5-hour end-to-end walkthrough of how large language models like ChatGPT are actually built — from tokenization and pretraining through supervised fine-tuning and RLHF. Karpathy explains everything in plain engineer-to-engineer language with no hype.

The AI community building the future with open source machine learning.