AI Just Evolved | Google's TITANS Changes Everything
Google TITANS and Sakana Transformer². AI gets memory and can keep learning after training.
2025-01-23 05:00:00 - AI Search
00:00 - Intro
00:34 - Google Titans architecture
01:44 - Transformers model and limitations
05:14 - Giving AI memory
06:35 - AI training vs test time
08:57 - Titans long term memory
12:59 - Titans architecture
19:50 - Pros and cons
24:00 - Performance of Titans models vs Transformers
27:31 - Sakana Transformer2
30:50 - Model design and rationale
32:24 - How Transformer2 works
36:00 - Transformer2 performance
38:12 - Conclusion