Publikationen

Publikationen der Arbeitsgruppe, die seit 2016 erschienen sind. Frühere Publikationen von Fabian Beck sind auf Google Scholar oder DBLP zu finden.

Performance Evolution Matrix: Visualizing Performance Variations along Software Versions

Art der Publikation: Beitrag in Sammelwerk

Performance Evolution Matrix: Visualizing Performance Variations along Software Versions

Autor(en):
Sandoval Alcocer, Juan Pablo; Beck, Fabian; Bergel, Alexandre
Titel des Sammelbands:
VISSOFT 2019, to appear
Verlag:
IEEE
Veröffentlichung:
2019
Datei:
Performance Evolution Matrix: Visualizing Performance Variations along Software Versions (545 KB)
Zitation:
Download BibTeX

Kurzfassung

Software performance may be significantly affected by source code modifications. Understanding the effect of these changes along different software versions is a challenging and necessary activity to debug performance failures. It is not sufficiently supported by existing profiling tools and visualization approaches. Practitioners would need to manually compare calling context trees and call graphs. We aim at better supporting the comparison of benchmark executions along multiple software versions. We propose Performance Evolution Matrix, an interactive visualization technique that contrasts runtime metrics to source code changes. It combines a comparison of time series data and execution graphs in a matrix layout, showing performance and source code metrics at different levels of granularity. The approach guides practitioners from the high-level identification of a performance regression to the changes that might have caused the issue. We conducted a controlled experiment with 12 participants to provide empirical evidence of the viability of our method. The results indicate that our approach can reduce the effort for identifying sources of performance regressions compared to traditional profiling visualizations.

Received the VISSOFT 2019 Best Paper Award