Accelerating real-time edge AI enables developers to build sensor processing systems

21-11-2024 | Microchip Technology | Test & Measurement

Microchip Technology has released its PolarFire FPGA Ethernet Sensor Bridge, which works with the NVIDIA Holoscan sensor processing platform to enable developers to build AI-driven sensor processing systems.

PolarFire FPGAs allow multi-protocol support, and this first solution to be released as part of the company's platform is compatible with MIPI CSI-2-based sensors and the MIPI D-PHY physical layer. Future solutions will support a wide range of sensors with different interfaces, including SLVS-EC 2.0, 12G SDI, CoaXPress 2.0 and JESD204B. The platform permits designers to leverage the power of the NVIDIA Holoscan ecosystem while taking advantage of the PolarFire FPGA's power-efficient technology with low-latency communication and multi-protocol sensor support.

NVIDIA Holoscan helps streamline the development and deployment of AI and HPC applications at the edge for real-time insights. It brings into a single platform the necessary hardware and software systems for low-latency sensor streaming and network connectivity. The platform includes optimised libraries for data processing, sample AI models for jump-starting AI inference pipeline development, template applications to enable rapid prototyping and core microservices to run streaming, imaging and other applications.

With its ability to bridge real-time sensor data to NVIDIA Holoscan, the NVIDIA IGX, and the NVIDIA Jetson platforms for edge AI and robotics, the PolarFire FPGA Ethernet Sensor Bridge unlocks new edge-to-cloud applications, enables AI/ML inferencing, and facilitates the adoption of AI in the medical, industrial, and automotive markets.

"The Ethernet sensor bridge is based on Microchip's highly power-efficient, secure and reliable PolarFire FPGA platform," said Bruce Weyer, vice president of Microchip's FPGA business unit. "By combining our flexible FPGA fabric with NVIDIA's advanced AI platform and multi-protocol support, we're empowering developers to create innovative, real-time solutions that will revolutionise sensor interfaces across a wide range of powerful AI-driven edge applications."

By using the low power consumption of PolarFire FPGA technology, the NVIDIA Holoscan Sensor Bridge efficiently manages high-bandwidth data from diverse sensors over Ethernet, allowing real-time, high-performance edge AI processing on NVIDIA AI platforms. The power-efficient design is also conducive for small-footprint and energy or cost-sensitive applications.

PolarFire FPGAs meet security concerns in sensor applications by providing embedded security and safety features to help protect against potential cyber threats and provide physical, device, design and data integrity. They are additionally designed with SEU immunity, making them highly reliable in environments subject to radiation, such as space or high-altitude applications and medical environments. The SEU immunity also helps reduce the risk of data corruption and system failures.

sebastian_springall.jpg

By Seb Springall

Seb Springall is a seasoned editor at Electropages, specialising in the product news sections. With a keen eye for the latest advancements in the tech industry, Seb curates and oversees content that highlights cutting-edge technologies and market trends.