» Current | 2022 | 2021 | 2020

Linley Newsletter

Grai Matter Pivots to Floating Point

September 6, 2022

Author: Bryon Moyer

Grai Matter Labs (GML) has adapted its deep-learning-accelerator (DLA) technology to audio as well as vision in its first formal product, dubbed Grai VIP. By moving from native INT16 processing to FP16, it has achieved sufficient accuracy and dynamic range for audio processing with high-enough quality for human consumption.

To accomplish this feat, the company modified its primary DLA core so that, in addition to handling much larger models than its predecessor, the chip can do so with fewer cores. GML also added CPUs and I/Os to flesh out an SoC that can run independently or under the direction of an external host for local processing to reduce cloud traffic, power, and latency while boosting privacy. Maximum neural-network performance is 1.5 trillion operations per second (TOPS, but instead using FP8, which should be similar to INT8) at 2.5W TDP.

GML revealed its event-based architecture three years ago with its Grai One proof-of-concept (PoC) chip, which focuses primarily on vision applications. By computing only when pixels change, it promises to do its work with less effort, saving energy. Grai One allowed the company to demonstrate its technology’s viability, enabling a new $14 million funding round in late 2020 for a total of $29 million. In its production configuration, GML has applied those ideas to audio as well.

GML has an initial Grai VIP die under evaluation with customers now; a production version, which may make small changes in I/O and other areas, is scheduled for 2H23. The company withheld pricing.

Subscribers can view the full article in the Microprocessor Report.

Subscribe to the Microprocessor Report and always get the full story!

Free Newsletter

Linley Newsletter
Analysis of new developments in microprocessors and other semiconductor products


Linley Spring Processor Conference 2022
Conference Dates: April 20-21, 2022
Hyatt Regency Hotel, Santa Clara, CA
Linley Fall Processor Conference 2021
Held October 20-21, 2021
Proceedings available
Linley Spring Processor Conference 2021
April 19 - 23, 2021
Proceedings Available
More Events »