Transformer Architecture
Attention complexity and FlashAttention, MHA vs MQA vs GQA, sparse and sliding-window attention, KV-cache math, Pre/Post-Norm and DeepNorm, attention sinks, head redundancy, and training-stability trade-offs.
Take the full module
These are the first few of 50 questions. A free account opens the rest as a scored drill.
- Every question in this module
- Instant feedback and supporting reading
- Your score and progress, saved
Free · your email is used for progress only.
About Nybble™
The AI space moves fast.
Nybble™ is how you keep up — and stay sharp.
What happened. In two minutes.
The AI news cycle moves at a pace no one can keep up with. Snack distills what launched, what shipped, and what matters — every day, without the filler.
Go to SnackThe concepts behind the headlines.
News tells you what. Stack tells you why and how. From RAG architectures to agentic evals, these are the ideas that will shape what you build next.
Go to StackProve you actually get it.
Reading about LangChain is not the same as knowing it. Hack challenges you with production-grade questions, then shows you the references that make the answer stick.
Go to Hack