Rakuten Interview Question

What is a transformer model

Interview Answer

Anonymous

May 27, 2025

Instead of processing words sequentially like RNNs or LSTMs, transformers look at all words in a sentence at once using a mechanism called self-attention.