Year overview
2017
The 2017 research paper Attention Is All You Need introduced the Transformer architecture. The authors evaluated the attention-based architecture on translation tasks. ↗
Change and influences
On 12 May 2017 the WannaCry attack also affected parts of England’s NHS and disrupted healthcare services. Event
NotPetya spread in part through a compromised update to Ukrainian accounting software M.E.Doc and affected organisations beyond Ukraine. Event
Further evidence remains open.
Languages and techniques
Firefox 57 enabled the parallel Quantum CSS engine on desktop and switched extensions to WebExtensions. Event
WebAssembly was enabled by default in Chrome 57 Beta; WebKit described support in Safari 11 and Microsoft in EdgeHTML 16 after an experimental phase. Event
On 7 March Mozilla announced WebAssembly in the regular Firefox release; it had been a Nightly experiment in 2016. Event
In November 2017 Mozilla reported that Firefox, Chrome, Safari and Edge supported WebAssembly. Event
In the Transformer translation model, an encoder processes the input while a decoder generates output step by step; self-attention weights relationships between sentence parts. Event
Key players
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser and Illia Polosukhin introduced the Transformer; their paper marks the contributions as equal. The UK National Audit Office investigated WannaCry’s impact on the NHS in England. Transformer · NHS
Market and everyday use
Unmigrated XPCOM extensions stopped working in Firefox 57; Firefox ESR and mobile versions may have had different schedules. Event
The WannaCry attack disrupted services in parts of England’s NHS; the audit reported cancelled appointments and longer journeys to some emergency departments. The full extent remained unknown. Event
Events
Figures and facts
An NHS report says the number of trusts disrupted by WannaCry changed from 81 to 80 after reclassification; it includes facilities that were not infected. Event
The Transformer conference paper reported 28.4 BLEU on the WMT 2014 English-to-German translation test; this is not a percentage of general language understanding. A later arXiv version contains conflicting English-to-French figures; the conference paper distinguishes comparison with single models from comparison with ensembles. Event
The UK National Audit Office report counted at least 80 of 236 NHS trusts in England as affected; its website says 81. Affected includes precautionary shutdowns. Event