On the Evaluation of Photometric Stereo Applications Testing Using Image Modifications

Franz Wotawa; Ledio Jehaj; Nicole Brosch

doi:10.1007/978-3-031-43240-8_3

On the Evaluation of Photometric Stereo Applications Testing Using Image Modifications

Franz Wotawa^*, Ledio Jehaj, Nicole Brosch

^*Corresponding author for this work

Institute of Software Technology (7160)

Research output: Chapter in Book/Report/Conference proceeding › Conference paper › peer-review

Abstract

Computer vision is vital for various applications like object tracking for autonomous driving or quality assurance. Hence, assuring that computer vision fulfills given quality criteria is essential and requires sufficient testing. In previous work, authors introduced a testing method relying on image modifications for a photometric stereo application. Image modifications include pixel errors or the rotation of images to be analyzed, revealing a substantial impact on the computed outcome of the photometric stereo application, depending on the applied modification. This paper focuses on whether we can reproduce the impact of image modifications in a real-world setup. In particular, we compare the impact of the rotation of the analyzed sample with the rotation modification applied to the image of the sample. The comparison indicates a similar effect when using rotation, showing that testing based on image modifications is valuable for verifying computer vision applications.

Original language	English
Title of host publication	Testing Software and Systems - 35th IFIP WG 6.1 International Conference, ICTSS 2023, Proceedings
Editors	Silvia Bonfanti, Angelo Gargantini, Paolo Salvaneschi
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	40-51
Number of pages	12
ISBN (Print)	9783031432392
DOIs	https://doi.org/10.1007/978-3-031-43240-8_3
Publication status	Published - 2023
Event	35th IFIPWG 6.1 International Conference on Testing Software and Systems: ICTSS 2023 - Bergamo, Italy Duration: 18 Sept 2023 → 20 Sept 2023

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	14131 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	35th IFIPWG 6.1 International Conference on Testing Software and Systems
Abbreviated title	ICTSS 2023
Country/Territory	Italy
City	Bergamo
Period	18/09/23 → 20/09/23

Keywords

Test automation
Test case generation
Testing computer vision applications

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-031-43240-8_3

Cite this

Wotawa, F., Jehaj, L., & Brosch, N. (2023). On the Evaluation of Photometric Stereo Applications Testing Using Image Modifications. In S. Bonfanti, A. Gargantini, & P. Salvaneschi (Eds.), Testing Software and Systems - 35th IFIP WG 6.1 International Conference, ICTSS 2023, Proceedings (pp. 40-51). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14131 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-43240-8_3

On the Evaluation of Photometric Stereo Applications Testing Using Image Modifications. / Wotawa, Franz; Jehaj, Ledio; Brosch, Nicole.
Testing Software and Systems - 35th IFIP WG 6.1 International Conference, ICTSS 2023, Proceedings. ed. / Silvia Bonfanti; Angelo Gargantini; Paolo Salvaneschi. Springer Science and Business Media Deutschland GmbH, 2023. p. 40-51 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14131 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference paper › peer-review

Wotawa, F, Jehaj, L & Brosch, N 2023, On the Evaluation of Photometric Stereo Applications Testing Using Image Modifications. in S Bonfanti, A Gargantini & P Salvaneschi (eds), Testing Software and Systems - 35th IFIP WG 6.1 International Conference, ICTSS 2023, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14131 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 40-51, 35th IFIPWG 6.1 International Conference on Testing Software and Systems, Bergamo, Italy, 18/09/23. https://doi.org/10.1007/978-3-031-43240-8_3

Wotawa F, Jehaj L, Brosch N. On the Evaluation of Photometric Stereo Applications Testing Using Image Modifications. In Bonfanti S, Gargantini A, Salvaneschi P, editors, Testing Software and Systems - 35th IFIP WG 6.1 International Conference, ICTSS 2023, Proceedings. Springer Science and Business Media Deutschland GmbH. 2023. p. 40-51. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-43240-8_3

Wotawa, Franz ; Jehaj, Ledio ; Brosch, Nicole. / On the Evaluation of Photometric Stereo Applications Testing Using Image Modifications. Testing Software and Systems - 35th IFIP WG 6.1 International Conference, ICTSS 2023, Proceedings. editor / Silvia Bonfanti ; Angelo Gargantini ; Paolo Salvaneschi. Springer Science and Business Media Deutschland GmbH, 2023. pp. 40-51 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{7fd5c59b23cd45c59ba320348e0f17ef,

title = "On the Evaluation of Photometric Stereo Applications Testing Using Image Modifications",

abstract = "Computer vision is vital for various applications like object tracking for autonomous driving or quality assurance. Hence, assuring that computer vision fulfills given quality criteria is essential and requires sufficient testing. In previous work, authors introduced a testing method relying on image modifications for a photometric stereo application. Image modifications include pixel errors or the rotation of images to be analyzed, revealing a substantial impact on the computed outcome of the photometric stereo application, depending on the applied modification. This paper focuses on whether we can reproduce the impact of image modifications in a real-world setup. In particular, we compare the impact of the rotation of the analyzed sample with the rotation modification applied to the image of the sample. The comparison indicates a similar effect when using rotation, showing that testing based on image modifications is valuable for verifying computer vision applications.",

keywords = "Test automation, Test case generation, Testing computer vision applications",

author = "Franz Wotawa and Ledio Jehaj and Nicole Brosch",

note = "Publisher Copyright: {\textcopyright} 2023, IFIP International Federation for Information Processing.; 35th IFIPWG 6.1 International Conference on Testing Software and Systems : ICTSS 2023, ICTSS 2023 ; Conference date: 18-09-2023 Through 20-09-2023",

year = "2023",

doi = "10.1007/978-3-031-43240-8_3",

language = "English",

isbn = "9783031432392",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "40--51",

editor = "Silvia Bonfanti and Angelo Gargantini and Paolo Salvaneschi",

booktitle = "Testing Software and Systems - 35th IFIP WG 6.1 International Conference, ICTSS 2023, Proceedings",

address = "Germany",

}

TY - GEN

T1 - On the Evaluation of Photometric Stereo Applications Testing Using Image Modifications

AU - Wotawa, Franz

AU - Jehaj, Ledio

AU - Brosch, Nicole

PY - 2023

Y1 - 2023

N2 - Computer vision is vital for various applications like object tracking for autonomous driving or quality assurance. Hence, assuring that computer vision fulfills given quality criteria is essential and requires sufficient testing. In previous work, authors introduced a testing method relying on image modifications for a photometric stereo application. Image modifications include pixel errors or the rotation of images to be analyzed, revealing a substantial impact on the computed outcome of the photometric stereo application, depending on the applied modification. This paper focuses on whether we can reproduce the impact of image modifications in a real-world setup. In particular, we compare the impact of the rotation of the analyzed sample with the rotation modification applied to the image of the sample. The comparison indicates a similar effect when using rotation, showing that testing based on image modifications is valuable for verifying computer vision applications.

AB - Computer vision is vital for various applications like object tracking for autonomous driving or quality assurance. Hence, assuring that computer vision fulfills given quality criteria is essential and requires sufficient testing. In previous work, authors introduced a testing method relying on image modifications for a photometric stereo application. Image modifications include pixel errors or the rotation of images to be analyzed, revealing a substantial impact on the computed outcome of the photometric stereo application, depending on the applied modification. This paper focuses on whether we can reproduce the impact of image modifications in a real-world setup. In particular, we compare the impact of the rotation of the analyzed sample with the rotation modification applied to the image of the sample. The comparison indicates a similar effect when using rotation, showing that testing based on image modifications is valuable for verifying computer vision applications.

KW - Test automation

KW - Test case generation

KW - Testing computer vision applications

UR - http://www.scopus.com/inward/record.url?scp=85174441795&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-43240-8_3

DO - 10.1007/978-3-031-43240-8_3

M3 - Conference paper

AN - SCOPUS:85174441795

SN - 9783031432392

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 40

EP - 51

BT - Testing Software and Systems - 35th IFIP WG 6.1 International Conference, ICTSS 2023, Proceedings

A2 - Bonfanti, Silvia

A2 - Gargantini, Angelo

A2 - Salvaneschi, Paolo

PB - Springer Science and Business Media Deutschland GmbH

T2 - 35th IFIPWG 6.1 International Conference on Testing Software and Systems

Y2 - 18 September 2023 through 20 September 2023

ER -