4 Reasons AI in 2024 is On An Exponential: Data, Mamba, and More

4 Reasons I am convinced AI is still on an exponential in 2024. From the crazy potential of data quality, the dramatic possibilities of new architectures like Mamba (summarised here in around 5 minutes!), hybrid architectures, prompt optimisation and more. And regardless of all of that, photo-realism is coming to video.

I'll also explore a 100 year old prediction, on this 2024 New Year in AI...

https://www.patreon.com/AIExplained

Fan Tweet: https://twitter.com/DrJimFan/status/1741499431474934165
Mamba: https://arxiv.org/abs/2312.00752
Mamba Tri Dao Interview: https://www.youtube.com/watch?v=OFFHiJzPpCQ&t=1902s
Albert Gu: https://twitter.com/_albertgu/status/1731727682814050570
AI Improvement Paper: https://arxiv.org/abs/2312.07413
Mistral Interview: https://www.youtube.com/watch?v=NhASk7rZsmU
Lukasz Kaiser on Inference Time Compute: https://www.youtube.com/watch?v=Vrvc2rPuXTE
W.A.L.T Video: https://twitter.com/DrJimFan/status/1740788207967736047
https://aicountdown.com/
AI Explained Orca: https://www.youtube.com/watch?v=Dt_UNg7Mchg
Let’s Verify: https://www.youtube.com/watch?v=hZTZYffRsKI
Q-Star: https://www.youtube.com/watch?v=ARf0WyFau0A&t=721s
1923 Cartoon: https://www.linkedin.com/posts/svpino_a-1923-cartoon-that-predicts-generative-ai-activity-7023655761272524800-GRsy/
Quadratic Complexity: https://medium.com/intel-tech/how-to-apply-transformers-to-time-series-models-spacetimeformer-e452f2825d2e
Striped Hyena: https://www.together.ai/blog/stripedhyena-7b
Illustrated Transformer: https://jalammar.github.io/illustrated-transformer/
Language Models as Optimizers: https://arxiv.org/abs/2309.03409
https://www.etched.com/
W.A.L.T https://www.tomsguide.com/news/walt-is-a-new-ai-video-tool-that-creates-photorealistic-clips-from-a-single-image-you-have-to-see-it-to-believe-it
S4: https://hazyresearch.stanford.edu/blog/2022-01-14-s4-1

https://www.patreon.com/AIExplained