Lecture 14 - Attention and transformers

Notes

• Box

Recording

• YouTube
• Mediasite

Readings

• Foster Chapter 9
• Attention Is All You Need, Vaswani et al., NeurIPS 2017

Useful Links

• The Illustrated Transformer by Jay Alammar
• Transformers from Scratch by Peter Bloem
• What Is ChatGPT Doing and Why Does It Work? by Stephen Wolfram
• Stanford CS25: Transformers United YouTube playlist