To Örebro University

oru.seÖrebro University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Utilising CI environment for efficient and effective testing of NFRs
Qvantel Sweden AB, Karlskrona, Sweden; Blekinge Institute of Technology, Karlskrona, Sweden.
Blekinge Institute of Technology, Karlskrona, Sweden.
Örebro University, Örebro University School of Business. (Department of Informatics, CERIS)ORCID iD: 0000-0002-0311-1502
Blekinge Institute of Technology, Karlskrona, Sweden.
2020 (English)In: Information and Software Technology, ISSN 0950-5849, E-ISSN 1873-6025, Vol. 117, article id 106199Article in journal (Refereed) Published
Abstract [en]

Context

Continuous integration (CI) is a practice that aims to continuously verify quality aspects of a software intensive system both for functional and non-functional requirements (NFRs). Functional requirements are the inputs of development and can be tested in isolation, utilising either manual or automated tests. In contrast, some NFRs are difficult to test without functionality, for NFRs are often aspects of functionality and express quality aspects. Lacking this testability attribute makes NFR testing complicated and, therefore, underrepresented in industrial practice. However, the emergence of CI has radically affected software development and created new avenues for software quality evaluation and quality information acquisition. Research has, consequently, been devoted to the utilisation of this additional information for more efficient and effective NFR verification.

Objective

We aim to identify the state-of-the-art of utilising the CI environment for NFR testing, hereinafter referred to as CI-NFR testing.

Method

Through rigorous selection, from an initial set of 747 papers, we identified 47 papers that describe how NFRs are tested in a CI environment. Evidence-based analysis, through coding, is performed on the identified papers in this SLR.

Results

Firstly, ten CI approaches are described by the papers selected, each describing different tools and nine different NFRs where reported to be tested. Secondly, although possible, CI-NFR testing is associated with eight challenges that adversely affect its adoption. Thirdly, the identified CI-NFR testing processes are tool-driven, but there is a lack of NFR testing tools that can be used in the CI environment. Finally, we proposed a CI framework for NFRs testing.

Conclusion

A synthesised CI framework is proposed for testing various NFRs, and associated CI tools are also mapped. This contribution is valuable as results of the study also show that CI-NFR testing can help improve the quality of NFR testing in practices.

Place, publisher, year, edition, pages
Elsevier, 2020. Vol. 117, article id 106199
Keywords [en]
Agile, Continuous integration, CI, DevOps, Non-functional requirement, NFR, Scaled agile framework, SAFe
National Category
Information Systems Software Engineering
Identifiers
URN: urn:nbn:se:oru:diva-79434DOI: 10.1016/j.infsof.2019.106199ISI: 000496874400005Scopus ID: 2-s2.0-85073572821OAI: oai:DiVA.org:oru-79434DiVA, id: diva2:1388993
Funder
Knowledge Foundation
Note

We would like to acknowledge that this work was supported by the KKS foundation through the S.E.R.T. Research Profile project at Blekinge Institute of Technology.

Available from: 2020-01-28 Created: 2020-01-28 Last updated: 2024-03-04Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Chatzipetrou, Panagiota

Search in DiVA

By author/editor
Chatzipetrou, Panagiota
By organisation
Örebro University School of Business
In the same journal
Information and Software Technology
Information SystemsSoftware Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 157 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf