The video loads from YouTube only after you press Play.

Fastformer: Additive Attention Can Be All You Need (Machine Learning Research Paper Explained)

A 36-minute video by Yannic Kilcher about Fastformer, attention and transformers, on the AI shelf. It was posted to r/MachineLearning as “[D] Paper Explained - Fastformer: Additive Attention Can Be All You Need (Full Video Analysis)”.

Yannic Kilcher, Video, 36 min, 2021, on the AI shelf

A research-paper walkthrough examining Fastformer and its additive-attention approach.