Snap Interview Question

Explain attention layer, self-attention, cross-attention, and multi-head attention layer.