This is a template post showing how to document a TLM session. Delete or archive this once real sessions start.
Title: Attention Is All You Need
Authors: Vaswani et al., 2017
Link: arxiv.org/abs/1706.03762
Name: Jane Smith
Affiliation: University of Trento
Slides: Download PDF
A brief summary of what was discussed, key takeaways, and any interesting questions that came up during the session.
You can write this in full Markdown — equations with LaTeX, code blocks, images, etc.
For example, the scaled dot-product attention is:
\[\text{Attention}(Q, K, V) = \text{softmax}\left(\frac{QK^T}{\sqrt{d_k}}\right)V\]Challenge: Implement a single-head attention mechanism from scratch in PyTorch.
Repository: github.com/contessid/tlm-lab-YYYY-MM
Results:
| Participant | Score | Notes |
|---|---|---|
| @username | … | … |