Skip to content
Kelford Press
Subscribe
The Decade of Attention cover

Kelford Press · 2026

The Decade of Attention

How Transformers Rebuilt Machine Learning, 2017–2027

By Dr. Priya Iyengar

No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means — electronic, mechanical, photocopying, recording, or otherwise — without the prior written permission of the publisher, except for brief quotations in reviews …

Contents

  1. 01Before Attention: The Sequence Problem
  2. 02The Paper
  3. 03The Pretraining Era: BERT, GPT-1, T5
  4. 04Scaling Up: GPT-2 and GPT-3
  5. 05The Compute Wall and Chinchilla's Lessons
  6. 06Alignment and ChatGPT
  7. 07The Open-Weights Awakening
  8. 08Architectural Variants: MoE and the State-Space Detour
  9. 09Multimodality and the Universal Encoder
  10. 10The Inference Frontier
  11. 11Reasoning, Tool Use, and Agents
  12. 12After Attention

Editions

Digital (PDF)
Free
Download PDF →
  • Print
    ISBN 978-1-7398-2241-1
    Sold out
  • Audio
    ISBN 978-1-7398-2242-8
    Sold out

Print runs are small. We'll contact you when the next batch ships.

← Back to the bookshelf