Companies collaborate on new car AI-based steering system

Arrow Electronics Inc. has developed a first-of-its-kind, AI-powered steering system. Powered by an advanced NVIDIA processor, it employs facial recognition technology to control the latest SAM (Semi-Autonomous Mobility) Car.

Quadriplegic race car driver Sam Schmidt recently drove at competitive speeds operating the new system that he steers through head motions. The company's engineers developed the new steering system utilising the latest NVIDIA Jetson AGX Orin module, the only platform able to deliver the high accuracy and low latency required to control a car at speeds up to 213mph.

A low-profile stereo camera pair located on the dash captures Schmidt's movements in real-time and feeds the data to the NVIDIA module. Using ML, the system processes the information and adjusts the steering angle automatically – within a few thousandths of a second.

The new AI steering replaces the car's original four-camera steering, which used an older, infrared motion-capture technology.

"With the AI, it's more controllable," said Schmidt. "There's no lag. It's instantaneous for high speed."

The steering enhancements could have everyday applications far beyond the racetrack. The technology could control vehicles and large equipment in farming, warehouses, public transit, and construction so the operator – physically disabled or not – could perform multiple tasks.

"The SAM Car has evolved into a technology platform that really personifies enabling the benefit of technology for as many people as possible," said Murdoch Fitzgerald, Arrow vice president of global engineering and design services.