ECOOP 2020
Sun 15 - Tue 17 November 2020 Online Conference
co-located with SPLASH 2020
Sun 15 Nov 2020 15:20 - 15:40 at SPLASH-I - S-5 Chair(s): Davide Ancona, Eli Tilevich
Mon 16 Nov 2020 03:20 - 03:40 at SPLASH-I - S-5 Chair(s): Davide Ancona, Jeremy Gibbons

We describe our experience over the last 15 months on a compiler testing technology transfer project: taking the GraphicsFuzz research project on randomized metamorphic testing of graphics shader compilers, and building the necessary tooling around it to provide a highly automated process for improving the Khronos Vulkan Conformance Test Suite (CTS) with test cases that expose fuzzer-found compiler bugs, or that plug gaps in test coverage. We present this tooling for test automation—gfauto—in detail, as well as our use of differential coverage and test case reduction as a method for automatically synthesising tests that fill coverage gaps. We explain the value that GraphicsFuzz has provided in automatically testing the ecosystem of tools for transforming, optimizing and validating Vulkan shaders, and the challenges brought by testing a tool ecosystem rather than a single tool. We discuss practical issues associated with putting automated metamorphic testing into production, and provide illustrative examples of bugs found during our work.

Conference Day
Sun 15 Nov

Displayed time zone: Central Time (US & Canada) change

Conference Day
Mon 16 Nov

Displayed time zone: Central Time (US & Canada) change

03:00 - 04:20
S-5Research Papers at SPLASH-I
Chair(s): Davide AnconaDIBRIS, University of Genova, Italy, Jeremy GibbonsDepartment of Computer Science, University of Oxford
03:00
20m
Talk
Model-View-Update-Communicate: Session Types meet the Elm Architecture
Research Papers
Simon FowlerUniversity of Glasgow
Link to publication DOI Pre-print Media Attached
03:20
20m
Talk
Putting Randomized Compiler Testing into Production
Research Papers
Alastair F. DonaldsonImperial College London, Hugues EvrardGoogle, Paul ThomsonGoogle
Link to publication DOI Media Attached
03:40
20m
Talk
Owicki-Gries Reasoning for C11 RAR
Research Papers
Sadegh DalvandiUniversity of Surrey, Simon DohertyUniversity of Sheffield, Brijesh DongolUniversity of Surrey, Heike WehrheimPaderborn University
Link to publication DOI Media Attached
04:00
20m
Talk
Test-Case Reduction via Test-Case Generation: Insights From the Hypothesis Reducer
Research Papers
David R. MacIverImperial College London, Alastair F. DonaldsonImperial College London
Link to publication DOI Media Attached