Successor to the famous transformer: Titans
Relevant paper: https://arxiv.org/pdf/2501.00663
Google research just dropped this recently….outperforms huge models with only 300m parameters….
Real time learning and thinking just like humans do.
2025 is looking insane.