SBFT Tool Competition 2023 - Cyber-Physical Systems Track

Matteo Biagiola; Stefan Klikovits; Jarkko Peltomäki; Vincenzo Riccio

doi:10.1109/SBFT59156.2023.00010

SBFT Tool Competition 2023 - Cyber-Physical Systems Track

Matteo Biagiola, Stefan Klikovits, Jarkko Peltomäki, Vincenzo Riccio

Institute of Business Informatics - Software Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference proceedings › peer-review

Abstract

We report on the organization and results of the third edition of the Cyber-Physical Systems tool competition, held as part of the SBFT workshop. Six tools (i.e., CRAG, EvoMBT, RIGAA, RoadSign, Spirale, and WOGAN) competed with the aim of triggering failures of two autonomous driving agents.We evaluated the effectiveness of the tools in exposing failures as well as the diversity of the generated failures. This report describes our methodology, the competitors, the results, and the challenges we faced while running the competition experiments.

Original language	English
Title of host publication	16th IEEE/ACM International Workshop on Search-Based and Fuzz Testing, SBFT 2023, Melbourne, Australia, May 14, 2023
Number of pages	10
DOIs	https://doi.org/10.1109/SBFT59156.2023.00010
Publication status	Published - May 2023

Fields of science

102006 Computer supported cooperative work (CSCW)
102015 Information systems
102016 IT security
102020 Medical informatics
102022 Software development
102027 Web engineering
102034 Cyber-physical systems
509026 Digitalisation research
502032 Quality management
502050 Business informatics
503015 Subject didactics of technical sciences

JKU Focus areas

Digital Transformation

Access to Document

10.1109/SBFT59156.2023.00010

Cite this

@inproceedings{d1b9f4ee2df34242a626aea450a91d88,

title = "SBFT Tool Competition 2023 - Cyber-Physical Systems Track",

abstract = "We report on the organization and results of the third edition of the Cyber-Physical Systems tool competition, held as part of the SBFT workshop. Six tools (i.e., CRAG, EvoMBT, RIGAA, RoadSign, Spirale, and WOGAN) competed with the aim of triggering failures of two autonomous driving agents.We evaluated the effectiveness of the tools in exposing failures as well as the diversity of the generated failures. This report describes our methodology, the competitors, the results, and the challenges we faced while running the competition experiments.",

author = "Matteo Biagiola and Stefan Klikovits and Jarkko Peltom{\"a}ki and Vincenzo Riccio",

year = "2023",

month = may,

doi = "10.1109/SBFT59156.2023.00010",

language = "English",

isbn = "979-8-3503-0183-0",

booktitle = "16th IEEE/ACM International Workshop on Search-Based and Fuzz Testing, SBFT 2023, Melbourne, Australia, May 14, 2023",

}

TY - GEN

T1 - SBFT Tool Competition 2023 - Cyber-Physical Systems Track

AU - Biagiola, Matteo

AU - Klikovits, Stefan

AU - Peltomäki, Jarkko

AU - Riccio, Vincenzo

PY - 2023/5

Y1 - 2023/5

N2 - We report on the organization and results of the third edition of the Cyber-Physical Systems tool competition, held as part of the SBFT workshop. Six tools (i.e., CRAG, EvoMBT, RIGAA, RoadSign, Spirale, and WOGAN) competed with the aim of triggering failures of two autonomous driving agents.We evaluated the effectiveness of the tools in exposing failures as well as the diversity of the generated failures. This report describes our methodology, the competitors, the results, and the challenges we faced while running the competition experiments.

AB - We report on the organization and results of the third edition of the Cyber-Physical Systems tool competition, held as part of the SBFT workshop. Six tools (i.e., CRAG, EvoMBT, RIGAA, RoadSign, Spirale, and WOGAN) competed with the aim of triggering failures of two autonomous driving agents.We evaluated the effectiveness of the tools in exposing failures as well as the diversity of the generated failures. This report describes our methodology, the competitors, the results, and the challenges we faced while running the competition experiments.

UR - https://ieeexplore.ieee.org/document/10190377

U2 - 10.1109/SBFT59156.2023.00010

DO - 10.1109/SBFT59156.2023.00010

M3 - Conference proceedings

SN - 979-8-3503-0183-0

BT - 16th IEEE/ACM International Workshop on Search-Based and Fuzz Testing, SBFT 2023, Melbourne, Australia, May 14, 2023

ER -

SBFT Tool Competition 2023 - Cyber-Physical Systems Track

Abstract

Fields of science

JKU Focus areas

Access to Document

Other files and links

Cite this