-
The Attention Zoo: Linear & Softmax Models Unified
An interactive guide to modern sequence models — explore architectures and recurrences across the linear-softmax landscape.
-
Story of Linear Time Sequence Modeling 📚
Summary of Linear Transformers
-
Story of Linear Time Sequence Modeling 📚
Summary of Linear Transformers
-
Raven (Part-2)
Architecture and Results
-
Raven (Part-1)
Memory as a set of Slots