Next.js Hacker News
top
|
new
|
ask
|
show
|
jobs
|
GitHub
A Visual Guide to Attention Variants in Modern LLMs
23 points by
Anon84
3 days ago |
1 comments
add comment
nv2156
Great read about the technical evidence around the shift from better attention to better serving of models. Just came across a companion piece around this
https://news.ycombinator.com/item?id=47388676