TY - JOUR
T1 - Evaluation of Perception Sensor Model Performance in Simulation based on Experimental Findings
AU - Bamminger, Nadine
AU - Li, Hexuan
AU - Wan, Li
AU - Magosi, Zoltan Ferenc
AU - Eichberger, Arno
PY - 2023/12/27
Y1 - 2023/12/27
N2 - The market introduction of automated driving functions poses a significant challenge in terms of safety validation, primarily due to the complexity of real traffic test cases. While virtual testing has emerged as a viable solution, the accurate replication of physical perception sensors in virtual environments remains a formidable task. This study presents an evaluation method for virtual perception sensors, specifically focusing on their performance in automated driving and real-driving behaviour scenarios. Real driving data from a proving ground is collected and integrated into a multi-body simulation software, employing a specialized toolbox for seamless conversion of recorded measurements into simulation-ready data. Virtual sensor models for LIDAR, Radar, and Camera, utilizing various machine learning approaches, are implemented within the simulation alongside commercial sensor models. The output of these models is compared to real measurement data using statistical metrics, including the Chebyshev Distance, Pearson Correlation Coefficient, and Cross-Correlation Coefficient. The evaluation highlights the accuracy and performance of the machine learning-based models and the importance of employing multiple metrics that consider both correlation and offset between simulated and measured data.
AB - The market introduction of automated driving functions poses a significant challenge in terms of safety validation, primarily due to the complexity of real traffic test cases. While virtual testing has emerged as a viable solution, the accurate replication of physical perception sensors in virtual environments remains a formidable task. This study presents an evaluation method for virtual perception sensors, specifically focusing on their performance in automated driving and real-driving behaviour scenarios. Real driving data from a proving ground is collected and integrated into a multi-body simulation software, employing a specialized toolbox for seamless conversion of recorded measurements into simulation-ready data. Virtual sensor models for LIDAR, Radar, and Camera, utilizing various machine learning approaches, are implemented within the simulation alongside commercial sensor models. The output of these models is compared to real measurement data using statistical metrics, including the Chebyshev Distance, Pearson Correlation Coefficient, and Cross-Correlation Coefficient. The evaluation highlights the accuracy and performance of the machine learning-based models and the importance of employing multiple metrics that consider both correlation and offset between simulated and measured data.
KW - Sensor model evaluation
KW - Simulation
KW - sensor modeling
KW - sensor modelling
KW - sensor model evaluation
KW - virtual simulation
UR - https://www.sciencedirect.com/science/article/pii/S2352146523012012
U2 - 10.1016/j.trpro.2023.11.902
DO - 10.1016/j.trpro.2023.11.902
M3 - Article
SN - 2352-1465
VL - 2023
SP - 143
EP - 150
JO - Transportation Research Procedia
JF - Transportation Research Procedia
IS - 73
ER -