The transformer is presented at NeurIPS
node
Vaswani and seven co-authors presented "Attention Is All You Need" at the 31st Conference on Neural Information Processing Systems in Long Beach, proposing a sequence architecture built on attention alone, without recurrence or convolution, and demonstrating it on two machine translation tasks with better quality and substantially less training time. The removal of sequential dependency was the consequential part: it made training throughput a function of how many accelerators could be pointed at the problem, and thereby made very large training runs an engineering question rather than a scheduling impossibility.
A node is not a place. Drawing it on a map would assert something about the world that no stored fact supports.
Read in · 1
Evidence · 1
Timeline
No dated observations are stored for this object. Atlas shows what was observed and when — it does not infer a history.
Connections · 2
- The transformer architectureconcerns
- Machine translationconcerns
Assembled narrative · 1
An assembled narrative is available for this object.
Observed changes · 0
No public Signals are attached to this object. Signals show what changed and when it was observed — never a direction or a rank.
Actions
/atlas?object=EVT_TRANSFORMER_PUBLISHED_2017