Performance Comparison of Two Search-Based Testing Strategies for ADAS System Validation

Florian Klück*, Martin Zimmermann, Franz Wotawa, Mihai Nica

*Korrespondierende/r Autor/-in für diese Arbeit

Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandBegutachtung

Abstract

In this paper, we compare the performance of a genetic algorithm for test parameter optimization with simulated annealing and random testing. Simulated annealing and genetic algorithm both represent search-based testing strategies. In the context of autonomous and automated driving, we apply these methods to iteratively optimize test parameters, to aim at obtaining critical scenarios that form the basis for virtual verification and validation of Advanced Driver Assistant System (ADAS). We consider a test scenario to be critical if the underlying parameter set causes a malfunction of the system equipped with the ADAS function (i.e., near-crash or crash of the vehicle). To assess the criticality of each test scenario we rely on time-to-collision (TTC), which is a well-known and often used time-based safety indicator for recognizing rear-end conflicts. For evaluating the performance of each testing strategy, we set up a simulation framework, where we automatically run simulations for each approach until a predefined minimal TTC threshold is reached or a maximal number of iterations has passed. The genetic algorithm-based approach showed the best performance by generating critical scenarios with the lowest number of required test executions, compared to random testing and simulated annealing.

Originalspracheenglisch
TitelTesting Software and Systems - 31st IFIP WG 6.1 International Conference, ICTSS 2019, Proceedings
Redakteure/-innenChristophe Gaston, Nikolai Kosmatov, Pascale Le Gall
Herausgeber (Verlag)Springer
Seiten140-156
Seitenumfang17
ISBN (Print)9783030312794
DOIs
PublikationsstatusVeröffentlicht - 1 Jan. 2019
Veranstaltung31st IFIP International Conference on Testing Software and Systems, ICTSS 2019 - Paris, Frankreich
Dauer: 15 Okt. 201917 Okt. 2019

Publikationsreihe

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band11812 LNCS
ISSN (Print)0302-9743
ISSN (elektronisch)1611-3349

Konferenz

Konferenz31st IFIP International Conference on Testing Software and Systems, ICTSS 2019
Land/GebietFrankreich
OrtParis
Zeitraum15/10/1917/10/19

ASJC Scopus subject areas

  • Theoretische Informatik
  • Informatik (insg.)

Fingerprint

Untersuchen Sie die Forschungsthemen von „Performance Comparison of Two Search-Based Testing Strategies for ADAS System Validation“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren