Publikationen

Publikationen der Arbeitsgruppe, die seit 2016 erschienen sind. Frühere Publikationen von Fabian Beck sind auf Google Scholar oder DBLP zu finden.

Can a Chatbot Support Software Engineers with Load Testing? Approach and Experiences

Art der Publikation: Beitrag in Sammelwerk

Can a Chatbot Support Software Engineers with Load Testing? Approach and Experiences

Autor(en):
Okanović, Dušan; Beck, Samuel; Merz, Lasse; Zorn, Christoph; Merino, Leonel; van Hoorn, André; Beck, Fabian
Titel des Sammelbands:
Proceedings of the ACM/SPEC International Conference on Performance Engineering
Seiten:
120-129
Verlag:
ACM
Veröffentlichung:
2020
Digital Object Identifier (DOI):
doi:10.1145/3358960.3375792
Datei:
Can a Chatbot Support Software Engineers with Load Testing? Approach and Experiences (0,93 MB)
Zitation:
Download BibTeX

Kurzfassung

Even though load testing is an established technique to assess load-related quality properties of software systems, it is applied only seldom and with questionable results. Indeed, configuring, executing, and interpreting results of a load test require high effort and expertise. Since chatbots have shown promising results for interactively supporting complex tasks in various domains (including software engineering), we hypothesize that chatbots can provide developers suitable support for load testing.

In this paper, we present PerformoBot, our chatbot for configuring and running load tests. In a natural language conversation, PerformoBot guides developers through the process of properly specifying the parameters of a load test, which is then automatically executed by PerformoBot using a state-of-the-art load testing tool. After the execution, PerformoBot provides developers a report that answers the respective concern. We report on results of a user study that involved 47 participants, in which we assessed our tool's acceptance and effectiveness. We found that participants in the study, particularly those with a lower level of expertise in performance engineering, had a mostly positive view of PerformoBot.