Cooperative perception or collective perception (CP) is an emerging and promising technology for intelligent transportation systems (ITS). It enables an ITS station (ITS-S) to share its local perception information with others by means of vehicle-to-X communication. The technology improved efficiency and safety in road transportation.
Now, Australian scientists have developed disruptive technology that allows autonomous vehicles to track running pedestrians hidden behind buildings and cyclists obscured by larger cars, trucks, and buses.
The iMOVE Cooperative Research Centre-funded project collaborating with the University of Sydney’s Australian Centre for Field Robotics and Australian connected vehicle solutions company Cohda Wireless has just released its new findings in a final report following three years of research and development.
The technology allows autonomous vehicles to tap into various viewpoints. Being hooked up to the one system significantly increases the range of perception, allowing connected vehicles to see things they wouldn’t normally do.
Scientists noted, “The technology said it could benefit all vehicles, not just those connected to the system.”
Professor Eduardo Nebot from the Australian Centre for Field Robotics said, “This is a game-changer for both human-operated and autonomous vehicles which we hope will substantially improve the efficiency and safety of road transportation. The connected vehicle was able to track a pedestrian visually obstructed by a building with CP information. This was achieved seconds before its local perception sensors or the driver could see the same pedestrian around the corner, providing extra time for the driver or the navigation stack to react to this safety hazard.”
In another experiment, scientists demonstrated the CP technology’s ability to interact with walking pedestrians safely. They also showed the expected behavior of a connected vehicle when interacting with a pedestrian rushing towards a designated crossing area.
Professor Nebot said, “Using the ITS system, the connected autonomous vehicle managed to take preemptive action: braking and stopping before the pedestrian crossing area based on the predicted movement of the pedestrian.”
“The pedestrian tracking, prediction, path planning, and decision making were based on the perception information received from the ITS roadside stations.”
“CP enables the smart vehicles to break the physical and practical limitations of onboard perception sensors.”
Lead project researcher Dr. Mao Shan said, “The research confirmed using CP could improve awareness of vulnerable road users and safety in many traffic scenarios.”
“Our research has demonstrated that a connected vehicle can ‘see’ a pedestrian around corners. More importantly, we demonstrate how connected autonomous vehicles can autonomously and safely interact with walking and running pedestrians, relying only on information from the ITS roadside station.”
Cohda Wireless Chief Technical Officer Professor Paul Alexander said, “the new technology has the potential to increase safety in scenarios with both human-operated and autonomous vehicles.”
“CP enables the smart vehicles to break the physical and practical limitations of onboard perception sensors, and embrace improved perception quality and robustness.”
“This could lower per-vehicle cost to facilitate the massive deployment of CAV technology.”
Professor Alexander said, “Using CP for manually driven connected vehicles also brings an attractive advantage of enabling perception capability without retrofitting the vehicle with perception sensors and the associated processing unit.”
iMOVE Managing Director Ian Christensen said, “The project was a great example of industry collaborating with scientists to unleash innovations and commercial and public good not just for the benefit of Australians, but road users all over the world, including pedestrians and cyclists.”
“When we bring industry and scientists together, we can achieve many great things as a nation. iMOVE CRC is proud to have initiated this exciting project and many others like it – which are all about getting our best and brightest minds working together to develop new technologies and innovations for real-world problems and needs.”
Report:
Development and Demonstrations of Cooperative Perception for Connected and Automated Vehicles.