1998 LeNet-5 2018 BERT From LeNet-5 to BERT Flexibility is important Algorithms are evolving, faster than ever The mathematical solutions keep advancing Unchained Integration A World without Chains General Purpose Data processing: Multi-core superscalar CPU Graphics processing and acceleration: Highly parallel multi-threaded GPU AI processing and dataflow acceleration: Dataflow Array