Austria’s Graz University of Technology (TU Graz) is developing an innovative camera system that recognizes pedestrians’ intention to cross the road and automatically changes traffic signals to accommodate them, as part of a project that was commissioned by the City of Vienna.
In Vienna there are around 200 push-button signalized pedestrian crossings that allow people to cross the road safely after a brief waiting time, which is annoying for many people. This often results in pedestrians not waiting for the green phase.
The innovative camera-based system recognizes the intention of pedestrians to cross the road and halts the traffic automatically. The system features a wide-angle camera mounted on each pedestrian traffic light and recognizes that someone wants to cross the street in seconds. When a pedestrian enters that zone, custom-designed deep-learning algorithms analyze their motion path, determining within a second whether or not they intend to cross the road. The system then works with the city’s existing traffic management equipment, determining how soon the signal controller can activate the ‘walk’ light, based on the current traffic flow. Once the light is illuminated, it stays lit long enough for all the people detected by the camera to safely get across. However, if the system sees that someone has approached the crossing but then left, it will cancel the walk-light request, allowing traffic to flow uninterrupted.
The system can detect individual or multiple pedestrians, including children and people, as the images are analyzed locally at the ‘edge’ within the camera unit. The pedestrian crossing signal is also equipped with a monitoring system that can report faults immediately.
“It requires one second to estimate the intention, and after two seconds the estimation becomes reliable,” explained Horst Possegger, the TU Graz team leader. “Using the current configurations, our system predicts that wish to cross three to four seconds before the button is actually pushed. This all sounds very simple, but two years of intensive research were necessary due to the complexity of the requirements.”
