Transformer
The neural-network architecture, introduced in 2017, that uses attention to relate every part of an input to every other part.
The transformer was described in the 2017 paper “Attention Is All You Need.” Its self-attention mechanism processes sequences in parallel, which made very large language, image and audio models practical to train.
Related: Large language model (LLM), Attention