How Transformers work in deep learning and NLP: an intuitive introduction – AI Summer
The famous paper “Attention is all you need” in 2017 changed the way we were thinking about attention. With enough… read more
What is transformer architecture and how does it power ChatGPT? – ThoughtSpot
In 2017 researchers from Google published a new neural net architecture called transformer which has been the basis for most… read more
The Illustrated Transformer (Alammar, 2018)
In this post, we will look at The Transformer – a model that uses attention to boost the speed with… read more
Neural Network Zoo – Asimov Institute
With new neural network architectures popping up every now and then, it’s hard to keep track of them all. Knowing all… read more
The Unpredictable Abilities Emerging From Large AI Models – Quanta Magazine
Recent investigations like the one Dyer worked on have revealed that LLMs can produce hundreds of “emergent” abilities — tasks… read more