Closing the RISC-V Compliance Gap: Looking from the Negative Testing Side

Vladimir Herdt; Daniel Große; Rolf Drechsler

Closing the RISC-V Compliance Gap: Looking from the Negative Testing Side

Vladimir Herdt
, Daniel Große
, Rolf Drechsler

Institute of Complex Systems

Research output: Chapter in Book/Report/Conference proceeding › Conference proceedings › peer-review

Abstract

Compliance testing for RISC-V is very important. Therefore, an official hand-written compliance test-suite is being actively developed. However, besides requiring significant manual effort, it focuses on positive testing (the implemented instructions work as expected) only and neglects negative testing (consider illegal instructions to also ensure that no additional/unexpected behavior is accidentally added). This leaves a large gap in compliance testing. In this paper we propose a fuzzing-based test-suite generation approach to close this gap. We found new bugs in several RISC-V simulators including riscvOVPsim from Imperas which is the official reference simulator for compliance testing.

Original language	English
Title of host publication	Design Automation Conference (DAC)
Number of pages	6
Publication status	Published - 2020

Fields of science

202005 Computer architecture
202017 Embedded systems
102 Computer Sciences
102005 Computer aided design (CAD)
102011 Formal languages

JKU Focus areas

Sustainable Development: Responsible Technologies and Management

Cite this

@inproceedings{98438f9ba0d645418da2918de6377dc3,

title = "Closing the RISC-V Compliance Gap: Looking from the Negative Testing Side",

abstract = "Compliance testing for RISC-V is very important. Therefore, an official hand-written compliance test-suite is being actively developed. However, besides requiring significant manual effort, it focuses on positive testing (the implemented instructions work as expected) only and neglects negative testing (consider illegal instructions to also ensure that no additional/unexpected behavior is accidentally added). This leaves a large gap in compliance testing. In this paper we propose a fuzzing-based test-suite generation approach to close this gap. We found new bugs in several RISC-V simulators including riscvOVPsim from Imperas which is the official reference simulator for compliance testing.",

author = "Vladimir Herdt and Daniel Gro{\ss}e and Rolf Drechsler",

year = "2020",

language = "English",

booktitle = "Design Automation Conference (DAC)",

}

TY - GEN

T1 - Closing the RISC-V Compliance Gap: Looking from the Negative Testing Side

AU - Herdt, Vladimir

AU - Große, Daniel

AU - Drechsler, Rolf

PY - 2020

Y1 - 2020

N2 - Compliance testing for RISC-V is very important. Therefore, an official hand-written compliance test-suite is being actively developed. However, besides requiring significant manual effort, it focuses on positive testing (the implemented instructions work as expected) only and neglects negative testing (consider illegal instructions to also ensure that no additional/unexpected behavior is accidentally added). This leaves a large gap in compliance testing. In this paper we propose a fuzzing-based test-suite generation approach to close this gap. We found new bugs in several RISC-V simulators including riscvOVPsim from Imperas which is the official reference simulator for compliance testing.

AB - Compliance testing for RISC-V is very important. Therefore, an official hand-written compliance test-suite is being actively developed. However, besides requiring significant manual effort, it focuses on positive testing (the implemented instructions work as expected) only and neglects negative testing (consider illegal instructions to also ensure that no additional/unexpected behavior is accidentally added). This leaves a large gap in compliance testing. In this paper we propose a fuzzing-based test-suite generation approach to close this gap. We found new bugs in several RISC-V simulators including riscvOVPsim from Imperas which is the official reference simulator for compliance testing.

M3 - Conference proceedings

BT - Design Automation Conference (DAC)

ER -