To Örebro University

oru.seÖrebro University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Exploring Classification Consistency of Natural Language Requirements Using GPT-4o
Örebro University, Örebro University School of Business. Department of Informatics.ORCID iD: 0000-0002-3265-7627
Örebro University, Örebro University School of Business. Department of Informatics.ORCID iD: 0000-0002-0311-1502
Örebro University, Örebro University School of Business. Department of Informatics.ORCID iD: 0000-0002-3722-6797
Örebro University, Örebro University School of Business. Department of Informatics.ORCID iD: 0000-0001-8604-8862
2025 (English)In: Software Business: 15th International Conference, ICSOB 2024, Utrecht, The Netherlands, November 18–20, 2024, Proceedings / [ed] Efi Papatheocharous; Siamak Farshidi; Slinger Jansen; Sonja Hyrynsalmi, Springer, 2025, Vol. 539, p. 44-50Conference paper, Published paper (Refereed)
Abstract [en]

Classifying natural language requirements (NLRs) is challenging, especially with large volumes. Research shows that Large Language Models can assist by categorizing NLRs into functional requirements (FR) and non-functional requirements (NFRs). However, Generative Pretrained Transformer (GPT) models are not typically favored for this task due to concerns about consistency. This paper investigates the consistency when a GPT model classifies NLRs into FRs and NFRs using a zero-shot learning approach. Results show that ChatGPT-4o performs better for FRs, a temperature parameter set to 1 yields the highest consistency, while NFR classification improves with higher temperatures.

Place, publisher, year, edition, pages
Springer, 2025. Vol. 539, p. 44-50
Series
Lecture Notes in Business Information Processing, ISSN 1865-1348, E-ISSN 1865-1356
Keywords [en]
Requirements, Classification, Large Language Model, Zero-Shot Learning
National Category
Information Systems, Social aspects
Identifiers
URN: urn:nbn:se:oru:diva-121182DOI: 10.1007/978-3-031-85849-9_4ISI: 001476891400004Scopus ID: 2-s2.0-105001270180ISBN: 9783031858482 (print)ISBN: 9783031858499 (electronic)OAI: oai:DiVA.org:oru-121182DiVA, id: diva2:1959807
Conference
15th International Conference (ICSOB 2024), Utrecht, The Netherlands, November 18–20, 2024
Available from: 2025-05-21 Created: 2025-05-21 Last updated: 2025-05-21Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Karlsson, FredrikChatzipetrou, PanagiotaGao, ShangHavstorm, Tanja Elina

Search in DiVA

By author/editor
Karlsson, FredrikChatzipetrou, PanagiotaGao, ShangHavstorm, Tanja Elina
By organisation
Örebro University School of Business
Information Systems, Social aspects

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 72 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf