Build a large language model (from scratch)

Understanding large language models

Working with text data

Coding attention mechanisms

Implementing a GPT model from scratch to generate text

Pretraining on unlabeled data

Fine-tuning for classification

Fine-tuning to follow instructions

Introduction to PyTorch

References and further reading

Exercise solutions

Adding bells and whistles to the training loop

Parameter-efficient fine-tuning with LoRA.