Proceedings of the Institute for System Programming of the RAS
RUS  ENG    JOURNALS   PEOPLE   ORGANISATIONS   CONFERENCES   SEMINARS   VIDEO LIBRARY   PACKAGE AMSBIB  
General information
Latest issue
Archive

Search papers
Search references

RSS
Latest issue
Current issues
Archive issues
What is RSS



Proceedings of ISP RAS:
Year:
Volume:
Issue:
Page:
Find






Personal entry:
Login:
Password:
Save password
Enter
Forgotten password?
Register


Proceedings of the Institute for System Programming of the RAS, 2024, Volume 36, Issue 6, Pages 103–114
DOI: https://doi.org/10.15514/ISPRAS-2024-36(6)-6
(Mi tisp941)
 

Could an LLM like chatGPT perform a functional size measurement using the COSMIC method?

F. Valdés-Soutoa, D. Torres-Robledob

a National Autonomous University of Mexico, Science Faculty, CDMX, Mexico
b National Autonomous University of Mexico, Research Institute in Applied Mathematics and Systems, CDMX, Mexico
DOI: https://doi.org/10.15514/ISPRAS-2024-36(6)-6
Abstract: The process of developing software is intricate and time-consuming. Resource estimation is one of the most important responsibilities in software development. Since it is currently the only acceptable metric, the functional size of the program is used to generate estimating models in a widely accepted manner. On the other hand, functional size measurement takes time. The use of artificial intelligence (AI) to automate certain software development jobs has gained popularity in recent years. Software functional sizing and estimation is one area where artificial intelligence may be used. In this study, we investigate how to apply the concepts and guidelines of the COSMIC method to measurements using ChatGPT 4o, a large language model (LLM). To determine whether ChatGPT can perform COSMIC measurements, we discovered that ChatGPT could not reliably produce accurate findings. The primary shortcomings found in ChatGPT include its incapacity to accurately extract data movements, data groups, and functional users from the text. Because of this, ChatGPT's measurements fall short of two essential requirements for measurement: accuracy and reproducibility.
Keywords: COSMIC, CFP, functional size measurement, LLM, chatGPT, software engineering, AI, automatization
Document Type: Article
Language: English
Citation: F. Valdés-Souto, D. Torres-Robledo, “Could an LLM like chatGPT perform a functional size measurement using the COSMIC method?”, Proceedings of ISP RAS, 36:6 (2024), 103–114
Citation in format AMSBIB
\Bibitem{ValTor24}
\by F.~Vald{\'e}s-Souto, D.~Torres-Robledo
\paper Could an LLM like chatGPT perform a functional size measurement using the COSMIC method?
\jour Proceedings of ISP RAS
\yr 2024
\vol 36
\issue 6
\pages 103--114
\mathnet{http://mi.mathnet.ru/tisp941}
Linking options:
  • https://www.mathnet.ru/eng/tisp941
  • https://www.mathnet.ru/eng/tisp/v36/i6/p103
  • Citing articles in Google Scholar: Russian citations, English citations
    Related articles in Google Scholar: Russian articles, English articles
    Proceedings of the Institute for System Programming of the RAS
    Statistics & downloads:
    Abstract page:39
    Full-text PDF :32
     
      Contact us:
     Terms of Use  Registration to the website  Logotypes © Steklov Mathematical Institute RAS, 2025