AI Just Evolved | Google's TITANS Changes Everything

Google TITANS and Sakana Transformer². AI gets memory and can keep learning after training.

00:00 - Intro

00:34 - Google Titans architecture

01:44 - Transformers model and limitations

05:14 - Giving AI memory

06:35 - AI training vs test time

08:57 - Titans long term memory

12:59 - Titans architecture

19:50 - Pros and cons

24:00 - Performance of Titans models vs Transformers

27:31 - Sakana Transformer2

30:50 - Model design and rationale

32:24 - How Transformer2 works

36:00 - Transformer2 performance

38:12 - Conclusion

AI Search
AI Search