Semiconductor Engineering

Use Inference Benchmarks Similar To Your Application

If an Inference IP supplier or Inference Accelerator Chip supplier offers a benchmark, it is probably ResNet-50. As a result, it might seem logical to use ResNet-50 to compare inference offerings. If ...
Semiconductor Engineering

Inference Acceleration: Follow The Memory

Much has been written about the computational complexity of inference acceleration: very large matrix multiplies for fully-connected layers and huge numbers of 3×3 convolutions across megapixel images ...
The Next Platform

MLPerf Inference Results Offer Glimpse into AI Chip Performance

There is much at stake in the world of datacenter inference and while the market has not yet decided its winners, there are finally some new metrics in the bucket to aid decision-making. Interpreting ...
Electronic Design

11 Myths About Inference Acceleration

It’s important to understand that an inference accelerator is a completely new kind of chip, with many unknowns for the broader market. In our industry, there’s a learning curve for everything, from ...
EDN

MLPerf expands AI inference benchmarks, Nvidia tops all tests

Nvidia has claimed performance records with its AI computing platform in the latest round of MLPerf AI inference benchmarks. MLPerf is the industry’s independent benchmark consortium that measures AI ...
Forbes

AI Inference Processes Data And Augments Human Abilities

Artificial Intelligence (AI) has been making headlines over the past few months with the widespread use and speculation about generative AI, such as Chat GPT. However, AI is a broad topic covering ...
The Next Platform

Habana Takes Training And Inference Down Different Paths

Processor hardware for machine learning is in their early stages but it already taking different paths. And that mainly has to do with dichotomy between training and inference. Not only do these two ...