ECOOP 2020
Sun 15 - Tue 17 November 2020 Online Conference
co-located with SPLASH 2020
Mon 16 Nov 2020 03:20 - 03:40 at OOPSLA/ECOOP - S-5
Sun 15 Nov 2020 15:20 - 15:40 at OOPSLA/ECOOP - S-5

We describe our experience over the last 15 months on a compiler testing technology transfer project: taking the GraphicsFuzz research project on randomized metamorphic testing of graphics shader compilers, and building the necessary tooling around it to provide a highly automated process for improving the Khronos Vulkan Conformance Test Suite (CTS) with test cases that expose fuzzer-found compiler bugs, or that plug gaps in test coverage. We present this tooling for test automation—gfauto—in detail, as well as our use of differential coverage and test case reduction as a method for automatically synthesising tests that fill coverage gaps. We explain the value that GraphicsFuzz has provided in automatically testing the ecosystem of tools for transforming, optimizing and validating Vulkan shaders, and the challenges brought by testing a tool ecosystem rather than a single tool. We discuss practical issues associated with putting automated metamorphic testing into production, and provide illustrative examples of bugs found during our work.

Sun 15 Nov
Times are displayed in time zone: (GMT-05:00) Central Time (US & Canada) change

15:00 - 16:20: S-5Research Papers at OOPSLA/ECOOP +12h
15:00 - 15:20
Talk
Research Papers
Simon FowlerUniversity of Glasgow
Pre-print
15:20 - 15:40
Talk
Research Papers
Alastair DonaldsonImperial College London, Hugues EvrardGoogle, Paul ThomsonGoogle
15:40 - 16:00
Talk
Research Papers
Sadegh DalvandiUniversity of Surrey, Simon DohertyUniversity of Sheffield, Brijesh DongolUniversity of Surrey, Heike WehrheimPaderborn University
16:00 - 16:20
Talk
Research Papers
David R. MacIverImperial College London, Alastair DonaldsonImperial College London

Mon 16 Nov
Times are displayed in time zone: (GMT-05:00) Central Time (US & Canada) change

03:00 - 04:20: S-5Research Papers at OOPSLA/ECOOP
03:00 - 03:20
Talk
Research Papers
Simon FowlerUniversity of Glasgow
Pre-print
03:20 - 03:40
Talk
Research Papers
Alastair DonaldsonImperial College London, Hugues EvrardGoogle, Paul ThomsonGoogle
03:40 - 04:00
Talk
Research Papers
Sadegh DalvandiUniversity of Surrey, Simon DohertyUniversity of Sheffield, Brijesh DongolUniversity of Surrey, Heike WehrheimPaderborn University
04:00 - 04:20
Talk
Research Papers
David R. MacIverImperial College London, Alastair DonaldsonImperial College London