Autonomous Mobility and the New Age of Sensor Fusion

Sensors Insights by Maria Vetrano

Marcellino Gemelli, director of global business development at Bosch Sensortec.
Marcellino Gemelli, director of global
business development at Bosch Sensortec.

Maria Vetrano, a public relations consultant at SEMI, had a sitdown with Marcellino Gemelli, director of global business development at Bosch Sensortec, to discuss the present and future state of sensor fusion. Marcellino will be presenting at the upcoming MEMS & Sensors Executive Congress on October 29-30, 2018 in Napa Valley, Calif. SEMI’s Maria Vetrano caught up with Gemelli to give MSEC attendees a preview of Gemelli’s feature presentation.

SEMI: Why are environmental sensors important to autonomous mobility devices?

Gemelli: When most of us think of autonomous systems, we think that they are driven by motion sensors and proximity sensors (e.g., radar, Lidar). When vertical location comes into play, however, in applications such as drones or asset tracking, pressure sensors become an integral part of flight control, navigation and positioning in GPS-challenged areas.

While not commonly considered an electronically enabled sense, the ability to “smell” the environment opens new opportunities. The quality of a user’s experience with personal cleaning robots and robo-taxis are good examples of where we might want to enable scent detection.

SEMI: I’ve never thought much about using sensors to detect smell. How would a robo-taxi or a cleaning robot benefit from scent detection?

Gemelli: Fully autonomous cars will inevitably give rise to robo-taxis. In fact, last month Volvo announced its fully electric robo-taxi, and in March 2018, Waymo announced that Jaguar Land Rover’s SUV would join Fiat Chrysler’s Chrysler Pacifica minivans in its planned fleet of robo-taxis, so we may see robo-taxis in the U.S. within the next five years.

Volvo Cars’ Volvo 360c is an autonomous “concept car” that could one day serve on a fleet of robo-taxis. Source: Volvo.
Volvo Cars’ Volvo 360c is an autonomous “concept car” that could one day serve on a fleet of robo-taxis. Source: Volvo.

With robo-taxis fast-approaching, we need technologies that provide the same level of oversight that a taxi driver once fulfilled. Gas sensors would function like an electronic nose (e-nose) in a robo-taxi to inform the taxi’s owner of prohibited passenger behavior, such as eating, drinking or smoking in the vehicle, which could potentially damage the vehicle’s interior. Camera sensors could record the act as proof of the offense.

Cleaning robots would be more sophisticated than they are today. In addition to leveraging image and range-finding sensors to more accurately map the rooms in your house, they could also detect scents from spilled red wine, pet urine or other foreign materials. When the cleaning robot, such as a vacuum, detects the foreign substance, it would navigate around the substance instead of going through it and spreading it all over the carpet. In addition to robo-taxis and cleaning robots, I will also discuss asset tracking and drones.

SEMI: What role does sensor fusion play in autonomous mobility devices?

Gemelli: Combing sensor fusion with artificial intelligence (AI) will generate new use cases and therefore new markets for sensor suppliers. There is another major benefit as well. With so many connected devices in our lives — including those with cameras, location awareness and always-listening capabilities — we are seeing growing concern about user privacy. Sensor fusion and AI can help to alleviate this concern: by supporting more local processing, they allow for greater control of data, safeguarding personal privacy.

SEMI: Who is responsible for the AI part of the sensor-fusion equation?

Gemelli: AI is a new frontier for MEMS and sensors suppliers. It benefits us and our customers to embrace AI algorithms through in-house development and/or partnerships.

SEMI: What would you like MEMS & Sensors Executive Congress attendees to take away from your presentation?

Gemelli: I plan to issue a call to action to increase research in hybrid sensor-fusion software architectures, including AI, as suppliers’ collaboration will benefit the industry at large.

 

About the author

Maria Vetrano is a public relations consultant at SEMI. She is a senior-level public relations professional with 20+ years of experience in PR and marketing. Expertise in range of technologies, including MEMS, sensors, semiconductors, consumer electronics and embedded systems.