» Current | 2021 | 2020 | 2019 | Subscribe

Linley Newsletter

Neural Engines Rev Up Mobile AI

January 23, 2018

Author: Mike Demler

Siri and Google Assistant popularized the use of machine learning applications on mobile devices. But they stream audio directly to the cloud, where deep neural networks (DNNs) running on powerful servers parse the spoken words. By contrast, new premium mobile processors can perform similar tasks directly thanks to their integrated neural-network engines (NNEs).

Although CPUs, GPUs, and DSPs can all run pretrained neural networks, they each make performance, power-consumption, precision, and programmability tradeoffs. Therefore, designers must employ heterogeneous-computing architectures that distribute the workload to the core best suited to each task. To further increase efficiency and enable more-complex machine learning, the trend is to augment the CPU/GPU/DSP complex with specialized deep-learning accelerators (DLAs).

Companies employing DLAs in their latest flagship processors include Apple, Huawei, and MediaTek. We expect Samsung will also integrate one in its next-generation Exynos. These integrated neural-network engines enable on-device machine-learning tasks ranging from keyword spotting for voice UIs to more complex biometric apps such as facial-, iris-, and voice-identification. Although the early focus for on-device machine learning has largely been AR, computer vision, and personal digital assistants, locking a smartphone to its owner will increase its use for a plethora of security-sensitive applications such as mobile payments, which can help thwart identity theft.

Subscribers can view the full article in the Microprocessor Report.

Subscribe to the Microprocessor Report and always get the full story!

Purchase the full article

Free Newsletter

Linley Newsletter
Analysis of new developments in microprocessors and other semiconductor products
Subscribe to our Newsletter »


Linley Fall Processor Conference 2021
Coming October 20-21, 2021
Hyatt Regency Hotel, Santa Clara, CA
Register Now!
Linley Spring Processor Conference 2021
April 19 - 23, 2021
Proceedings Available
More Events »