Self-attention
An attention mechanism that compares positions within the same sequence, helping a model connect relevant parts of an input with each other.
By Mega AI Hub Editorial · Models & architecture
5,141,568 AI resources indexedWorking toward the world’s largest AI resource index.
An attention mechanism that compares positions within the same sequence, helping a model connect relevant parts of an input with each other.
By Mega AI Hub Editorial · Models & architecture