Attention Mechanism

AI

A technique in neural networks that allows the model to focus on relevant parts of the input when processing information. Attention mechanisms compute weights indicating which inputs are most important, enabling better context awareness.