Skip to content
RichseenAtlasAtlasSign in

The transformer is presented at NeurIPS

node

Vaswani and seven co-authors presented "Attention Is All You Need" at the 31st Conference on Neural Information Processing Systems in Long Beach, proposing a sequence architecture built on attention alone, without recurrence or convolution, and demonstrating it on two machine translation tasks with better quality and substantially less training time. The removal of sequential dependency was the consequential part: it made training throughput a function of how many accelerators could be pointed at the problem, and thereby made very large training runs an engineering question rather than a scheduling impossibility.

A node is not a place. Drawing it on a map would assert something about the world that no stored fact supports.

Read in · 1

Evidence · 1
Timeline

No dated observations are stored for this object. Atlas shows what was observed and when — it does not infer a history.

Connections · 2
Assembled narrative · 1

An assembled narrative is available for this object.

Observed changes · 0

No public Signals are attached to this object. Signals show what changed and when it was observed — never a direction or a rank.

Actions

Read the assembled narrativeContinue in StudioOpen TwinTwin does not start a decision from this kind of object.ShareSaveSaved objects are part of the authenticated projection, which is declared and not yet built.

/atlas?object=EVT_TRANSFORMER_PUBLISHED_2017