One to Rule them All: A Study on Requirement Management Tools for the Development of Modern AI-based Software

Abdul Rasheed Ottun; Mehrdad Asadi; Michell Boerger; Nikolay Tcholtchev; Joao Goncalves; Dusan Borovcanin; Bartlomiej Siniarsk; Huber Flores

doi:10.1109/BigData59044.2023.10386926

One to Rule them All: A Study on Requirement Management Tools for the Development of Modern AI-based Software

Abdul Rasheed Ottun, Mehrdad Asadi, Michell Boerger, Nikolay Tcholtchev, Joao Goncalves, Dusan Borovcanin, Bartlomiej Siniarsk, Huber Flores

Informatics and Applied Informatics

Research output: Chapter in Book/Report/Conference proceeding › Conference paper

1 Citation (Scopus)

Abstract

Modern system architectures are rapidly adopting AI-based functionality. As a result, new requirements about software trustworthiness must be considered during the entire software development life cycle of applications. While several requirement management tools are available to track and monitor requirements over time, it is still unknown to what extent these tools can cope with these new demands imposed by AI. In this paper, we contribute by performing a qualitative and quantitative analysis of different requirement management tools and their performance in managing AI-related requirements effectively. Through a rigorous analysis performed by a consortium formed by different industry and academic partners, we evaluate the suitability of five different requirement management tools. Our results indicate that while several tools are available for managing requirements, it is currently challenging to find a tool that can manage AI requirements mainly because tools do not comply with the required aspects imposed by regulatory entities. Lastly, we also shared our lessons learned and experiences from selecting requirement tools that can be used in team-based consortium projects.

Original language	English
Title of host publication	Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023
Editors	Jingrui He, Themis Palpanas, Xiaohua Hu, Alfredo Cuzzocrea, Dejing Dou, Dominik Slezak, Wei Wang, Aleksandra Gruca, Jerry Chun-Wei Lin, Rakesh Agrawal
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	3556-3565
Number of pages	10
ISBN (Electronic)	9798350324457
DOIs	https://doi.org/10.1109/BigData59044.2023.10386926
Publication status	Published - 2023
Event	2023 IEEE International Conference on Big Data, BigData 2023 - Sorrento, Italy Duration: 15 Dec 2023 → 18 Dec 2023

Publication series

Name	Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023

Conference

Conference	2023 IEEE International Conference on Big Data, BigData 2023
Country/Territory	Italy
City	Sorrento
Period	15/12/23 → 18/12/23

Bibliographical note

Funding Information:
This research is part of SPATIAL project that has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No.101021808.

Funding Information:
This research is part of SPATIAL project that has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No.101021808.

Publisher Copyright:
© 2023 IEEE.

Keywords

AI Applications
Trustworthy AI
XAI

Access to Document

10.1109/BigData59044.2023.10386926

Handle.net

Persistent link

Cite this

Ottun, A. R., Asadi, M., Boerger, M., Tcholtchev, N., Goncalves, J., Borovcanin, D., Siniarsk, B., & Flores, H. (2023). One to Rule them All: A Study on Requirement Management Tools for the Development of Modern AI-based Software. In J. He, T. Palpanas, X. Hu, A. Cuzzocrea, D. Dou, D. Slezak, W. Wang, A. Gruca, J. C.-W. Lin, & R. Agrawal (Eds.), Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023 (pp. 3556-3565). (Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BigData59044.2023.10386926

Ottun, Abdul Rasheed ; Asadi, Mehrdad ; Boerger, Michell et al. / One to Rule them All: A Study on Requirement Management Tools for the Development of Modern AI-based Software. Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023. editor / Jingrui He ; Themis Palpanas ; Xiaohua Hu ; Alfredo Cuzzocrea ; Dejing Dou ; Dominik Slezak ; Wei Wang ; Aleksandra Gruca ; Jerry Chun-Wei Lin ; Rakesh Agrawal. Institute of Electrical and Electronics Engineers Inc., 2023. pp. 3556-3565 (Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023).

@inproceedings{f0bc971b203a436ca7f922510dd5ed64,

title = "One to Rule them All: A Study on Requirement Management Tools for the Development of Modern AI-based Software",

abstract = "Modern system architectures are rapidly adopting AI-based functionality. As a result, new requirements about software trustworthiness must be considered during the entire software development life cycle of applications. While several requirement management tools are available to track and monitor requirements over time, it is still unknown to what extent these tools can cope with these new demands imposed by AI. In this paper, we contribute by performing a qualitative and quantitative analysis of different requirement management tools and their performance in managing AI-related requirements effectively. Through a rigorous analysis performed by a consortium formed by different industry and academic partners, we evaluate the suitability of five different requirement management tools. Our results indicate that while several tools are available for managing requirements, it is currently challenging to find a tool that can manage AI requirements mainly because tools do not comply with the required aspects imposed by regulatory entities. Lastly, we also shared our lessons learned and experiences from selecting requirement tools that can be used in team-based consortium projects. ",

keywords = "AI Applications, Trustworthy AI, XAI",

author = "Ottun, {Abdul Rasheed} and Mehrdad Asadi and Michell Boerger and Nikolay Tcholtchev and Joao Goncalves and Dusan Borovcanin and Bartlomiej Siniarsk and Huber Flores",

note = "Funding Information: This research is part of SPATIAL project that has received funding from the European Union{\textquoteright}s Horizon 2020 research and innovation programme under grant agreement No.101021808. Funding Information: This research is part of SPATIAL project that has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No.101021808. Publisher Copyright: {\textcopyright} 2023 IEEE.; 2023 IEEE International Conference on Big Data, BigData 2023 ; Conference date: 15-12-2023 Through 18-12-2023",

year = "2023",

doi = "10.1109/BigData59044.2023.10386926",

language = "English",

series = "Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "3556--3565",

editor = "Jingrui He and Themis Palpanas and Xiaohua Hu and Alfredo Cuzzocrea and Dejing Dou and Dominik Slezak and Wei Wang and Aleksandra Gruca and Lin, {Jerry Chun-Wei} and Rakesh Agrawal",

booktitle = "Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023",

address = "United States",

}

Ottun, AR, Asadi, M, Boerger, M, Tcholtchev, N, Goncalves, J, Borovcanin, D, Siniarsk, B & Flores, H 2023, One to Rule them All: A Study on Requirement Management Tools for the Development of Modern AI-based Software. in J He, T Palpanas, X Hu, A Cuzzocrea, D Dou, D Slezak, W Wang, A Gruca, JC-W Lin & R Agrawal (eds), Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023. Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023, Institute of Electrical and Electronics Engineers Inc., pp. 3556-3565, 2023 IEEE International Conference on Big Data, BigData 2023, Sorrento, Italy, 15/12/23. https://doi.org/10.1109/BigData59044.2023.10386926

One to Rule them All: A Study on Requirement Management Tools for the Development of Modern AI-based Software. / Ottun, Abdul Rasheed; Asadi, Mehrdad; Boerger, Michell et al.
Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023. ed. / Jingrui He; Themis Palpanas; Xiaohua Hu; Alfredo Cuzzocrea; Dejing Dou; Dominik Slezak; Wei Wang; Aleksandra Gruca; Jerry Chun-Wei Lin; Rakesh Agrawal. Institute of Electrical and Electronics Engineers Inc., 2023. p. 3556-3565 (Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023).

Research output: Chapter in Book/Report/Conference proceeding › Conference paper

TY - GEN

T1 - One to Rule them All: A Study on Requirement Management Tools for the Development of Modern AI-based Software

AU - Ottun, Abdul Rasheed

AU - Asadi, Mehrdad

AU - Boerger, Michell

AU - Tcholtchev, Nikolay

AU - Goncalves, Joao

AU - Borovcanin, Dusan

AU - Siniarsk, Bartlomiej

AU - Flores, Huber

N1 - Funding Information: This research is part of SPATIAL project that has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No.101021808. Funding Information: This research is part of SPATIAL project that has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No.101021808. Publisher Copyright: © 2023 IEEE.

PY - 2023

Y1 - 2023

N2 - Modern system architectures are rapidly adopting AI-based functionality. As a result, new requirements about software trustworthiness must be considered during the entire software development life cycle of applications. While several requirement management tools are available to track and monitor requirements over time, it is still unknown to what extent these tools can cope with these new demands imposed by AI. In this paper, we contribute by performing a qualitative and quantitative analysis of different requirement management tools and their performance in managing AI-related requirements effectively. Through a rigorous analysis performed by a consortium formed by different industry and academic partners, we evaluate the suitability of five different requirement management tools. Our results indicate that while several tools are available for managing requirements, it is currently challenging to find a tool that can manage AI requirements mainly because tools do not comply with the required aspects imposed by regulatory entities. Lastly, we also shared our lessons learned and experiences from selecting requirement tools that can be used in team-based consortium projects.

AB - Modern system architectures are rapidly adopting AI-based functionality. As a result, new requirements about software trustworthiness must be considered during the entire software development life cycle of applications. While several requirement management tools are available to track and monitor requirements over time, it is still unknown to what extent these tools can cope with these new demands imposed by AI. In this paper, we contribute by performing a qualitative and quantitative analysis of different requirement management tools and their performance in managing AI-related requirements effectively. Through a rigorous analysis performed by a consortium formed by different industry and academic partners, we evaluate the suitability of five different requirement management tools. Our results indicate that while several tools are available for managing requirements, it is currently challenging to find a tool that can manage AI requirements mainly because tools do not comply with the required aspects imposed by regulatory entities. Lastly, we also shared our lessons learned and experiences from selecting requirement tools that can be used in team-based consortium projects.

KW - AI Applications

KW - Trustworthy AI

KW - XAI

UR - http://www.scopus.com/inward/record.url?scp=85184985030&partnerID=8YFLogxK

U2 - 10.1109/BigData59044.2023.10386926

DO - 10.1109/BigData59044.2023.10386926

M3 - Conference paper

AN - SCOPUS:85184985030

T3 - Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023

SP - 3556

EP - 3565

BT - Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023

A2 - He, Jingrui

A2 - Palpanas, Themis

A2 - Hu, Xiaohua

A2 - Cuzzocrea, Alfredo

A2 - Dou, Dejing

A2 - Slezak, Dominik

A2 - Wang, Wei

A2 - Gruca, Aleksandra

A2 - Lin, Jerry Chun-Wei

A2 - Agrawal, Rakesh

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2023 IEEE International Conference on Big Data, BigData 2023

Y2 - 15 December 2023 through 18 December 2023

ER -

Ottun AR, Asadi M, Boerger M, Tcholtchev N, Goncalves J, Borovcanin D et al. One to Rule them All: A Study on Requirement Management Tools for the Development of Modern AI-based Software. In He J, Palpanas T, Hu X, Cuzzocrea A, Dou D, Slezak D, Wang W, Gruca A, Lin JCW, Agrawal R, editors, Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 3556-3565. (Proceedings - 2023 IEEE International Conference on Big Data, BigData 2023). doi: 10.1109/BigData59044.2023.10386926

One to Rule them All: A Study on Requirement Management Tools for the Development of Modern AI-based Software

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Handle.net

Other files and links

Fingerprint

Cite this