Attention
A mechanism that helps a model weigh relationships between parts of its input. In a language model, it helps connect a word or token with relevant surrounding information.
By Mega AI Hub Editorial · Models & architecture
5,127,176 AI resources indexedWorking toward the world’s largest AI resource index.
A mechanism that helps a model weigh relationships between parts of its input. In a language model, it helps connect a word or token with relevant surrounding information.
By Mega AI Hub Editorial · Models & architecture