AI Inference Processor Cranks Up Performance Levels

Habana Labs describes its Goya HL-1000 as the world’s highest performance artificial intelligence (AI) inference processor. A PCIe card based on the HL-1000 processor delivers 15,000 images/second throughput on the ResNet-50 inference benchmark, with 1.3-ms latency, while consuming 100W of power. 

 

Allegedly, company’s AI processors offer one to three orders of magnitude better performance than solutions commonly deployed in data centers today. Designed to process various AI inferencing workloads such as image recognition, neural machine translation, sentiment analysis, recommender systems and many other applications, the Goya platform has been designed from the ground up for deep learning inference. It incorporates a fully programmable Tensor Processing Core (TPC™) along with development tools, libraries and a compiler, that collectively deliver a comprehensive, high performance and power efficient platform.

Sponsored by Digi-Key

TE Connectivity Horticultural Lighting Solutions Available Now from Digi-Key

TE connector, relay and filter solutions can help create a fine maze network of power-cabling to the lights needed for vertical farming. Their solutions are interchangeable, easy-to-install, and will last for years in variable humidity environments.

 

Habana Labs' SynapseAI software stack analyzes the trained model input and optimizes it for inferencing efficiently on the Goya processor. The software includes a rich kernel library and its toolchain is open for adding proprietary kernels by customers, as it interfaces seamlessly with popular deep learning neural-network frameworks such as TensorFlow and ONNX. For more information, visit Habana Labs.

Suggested Articles

Eta Compute Inc. has begun shipping its ECM3532 multicore processor for embedded sensor applications.

With coronavirus showing no signs of letting up soon, industry trade shows such as Mobile World Congress are being cancelled.

Sony Electronics Inc. is jumping into the STEAM (Science Technology Engineering Art and Math) arena with its first annual KOOV Challenge USA.