Selection of software, a systematic review

Authors

  • Andrés Leonardo Rojas Duarte Universidad Distrital
  • Yoan Pinzón Universidad Distrital
  • Feliz Antonio Cortez Aldana Universidad Distrital

Keywords:

Software selection, multiple-criteria decision analysis, Software engineering

Abstract

Software selection is a process in which several decision makers are involved, which have different preferencesthat could be mutually exclusive,this added to the different criteria that should be consider when evaluating the alternatives, makes this type of situation a multicriteria decision problem, that can be approached from the multiple-criteria analysis perspective. In this paper, a systematic review of software selection is presented, with the main goal of establishing an academic support for this type of process. To elaborate the state of the art, research questions, the inclusion criteria of the documents, the search process and analyze data to answer the questions identified, were defined. The main contribution of this paper is the determination of the methodologies used and the set of criteria that can be taken as a basis for the evaluation of alternatives, to choose the most appropriate according to the context of the software selection process.

Downloads

Download data is not yet available.

References

A. S. Alghamdi, I. Ahmad, and M. Nasir, “Selecting the best alternative SOA service bus for C4I systems using multi-criteria decision making technique,” in 2010 IEEE Region 8 International Conference on Computational Technologies in Electrical and Electronics Engineering (SIBIRCON), 2010, pp. 790–795.

A. S. Andreou and M. Tziakouris, “A quality framework for developing and evaluating original software components,” Inf. Softw. Technol., vol. 49, no. 2, pp. 122–141, Feb. 2007.

C. Ayala, Ø. Hauge, R. Conradi, X. Franch, and J. Li, “Selection of third party software in Off-The-Shelf-based software development—An interview study with industrial practitioners,” J. Syst. Softw., vol. 84, no. 4, pp. 620–637, Apr. 2011.

V. Belton and T. J. Stewart, “Multiple Criteria Decision Analysis: An Integrated Approach,” 2001.

N. Bhargava, A. Aziz, R. Arya, A. Prof, and I. Technology, “Selection Criteria for Data Mining Software : A Study,” Int. J. Comput. Sci. Issues, vol. 10, no. 3, pp. 308–312, 2013.

J. P. Carvallo, X. Franch, C. Quer, and U. P. De Catalunya, “Determining criteria for selecting Software Components: Lessons Learned,” Ieee Softw., p. 11, 2007.

U. Cebeci, “Fuzzy AHP-based decision support system for selecting ERP systems in textile industry by using balanced scorecard,” Expert Syst. Appl., vol. 36, no. 5, pp. 8900–8909, 2009.

P. Y. K. Chau, “Factors used in the selection of packaged software in small businesses: Views of owners and managers,” Inf. Manag., vol. 29, pp. 71–78, 1995.

P. Clements, F. Bachmann, L. Bass, D. Garlan, J. Ivers, R. Little, P. Merson, R. Nord, and J. Stafford, Documenting Software Architectures: Views and Beyond. Pearson Education, 2010.

J. K. Cochran and H.-N. Chen, “Fuzzy multi-criteria selection of object-oriented simulation software for production system analysis,” Comput. Oper. Res., vol. 32, no. 1, pp. 153–168, Jan. 2005.

K. Collier, B. Carey, D. Sautter, and C. Marjaniemi, “A methodology for evaluating and selecting data mining software,” in Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers, 1999, vol. Track6, p. 11.

E. Colombo and C. Francalanci, “Selecting CRM packages based on architectural, functional, and cost requirements: Empirical validation of a hierarchical ranking model,” Requirements Eng, 2004. [Online]. Available: http://www.it.iitb.ac.in/~palwencha/mtp_sec/Prashant Palwencha/lic/pap1412/selecting CRM packages vol9no3.pdf. [Accessed: 15-Sep-2014].

J. A. Z. Cortés, M. D. A. Serna, and W. A. Jaimes, “Applying fuzzy extended analytical hierarchy (FEAHP) for selecting logistics software,” Ing. e Investig., vol. 32, no. 1, pp. 94–99, 2012.

D. Garlan and M. Shaw, “An Introduction to Software Architecture,” Knowl. Creat. Diffus. Util., vol. 1, no. January, pp. 1–40, 1994.

M. Godse and S. Mulik, “An approach for selecting Software-as-a-Service (SaaS) product,” CLOUD 2009 - 2009 IEEE Int. Conf. Cloud Comput., pp. 155–158, 2009.

I. Gorton, A. Liu, and P. Brebner, “Rigorous evaluation of cots middleware technology,” Computer (Long. Beach. Calif)., vol. 36, no. 3, pp. 50–55, Mar. 2003.

I. Gorton, Essential Software. Springer, 2011.

T. Gürbüz, S. E. Alptekin, and G. Işiklar Alptekin, “A hybrid MCDM methodology for ERP selection problem with interacting criteria,” Decis. Support Syst., vol. 54, pp. 206–214, 2012.

N. Haghpanah, S. Moaven, J. Habibi, M. Kargar, and S. H. Yeganeh, “Approximation Algorithms for Software Component Selection Problem,” 14th Asia-Pacific Softw. Eng. Conf., pp. 159–166, 2007.

V. Hlupic and R. J. Paul, “Methodological approach to manufacturing simulation software selection,” Comput. Integr. Manuf. Syst., vol. 9, no. 1, pp. 49–55, Feb. 1996.

X. Huang, T. Lu, X. Ding, T. Liu, and N. Gu, “A provenance-based solution for software selection in scientific software sharing,” Proc. 2013 IEEE 17th Int. Conf. Comput. Support. Coop. Work Des. CSCWD 2013, pp. 172–177, 2013.

X. B. Illa, X. Franch, and J. A. Pastor, “Formalising ERP selection criteria,” in Tenth International Workshop on Software Specification and Design. IWSSD-10 2000, 2000, pp. 115–122.

A. S. Jadhav and R. M. Sonar, “Framework for evaluation and selection of the software packages: A hybrid knowledge based system approach,” J. Syst. Softw., vol. 84, no. 8, pp. 1394–1407, Aug. 2011.

A. Jadhav and R. Sonar, “Analytic Hierarchy Process (AHP), Weighted Scoring Method (WSM), and Hybrid Knowledge Based System (HKBS) for Software Selection: A Comparative Study,” in 2009 Second International Conference on Emerging Trends in Engineering & Technology, 2009, pp. 991–997.

A. Jadhav and R. Sonar, “A Hybrid System for Selection of the Software Packages,” in 2008 First International Conference on Emerging Trends in Engineering and Technology, 2008, pp. 337–342.

G. Jaime, “A hybrid method for information technologies selection combining multi-criteria decision making ( MCDM ) with technology roadmapping,” 2013.

A. Jansen and J. Bosch, “Software Architecture as a Set of Architectural Design Decision,” Proceedings of the 5th Working IEEE/IFIP Conference on Software Architecture, 2005. [Online]. Available: http://www.ics.uci.edu/~andre/ics223w2006/jansenbosch.pdf. [Accessed: 14-Sep-2014].

H. J. H. Jianhua, Z. S. Z. Shugong, Z. G. Z. Guangfeng, and L. C. L. Chunrui, “A study on ERP system software selecting evaluation based on fuzzy neural network model,” Adv. Comput. Theory Eng. (ICACTE), 2010 3rd Int. Conf., vol. 1, pp. 365–368, 2010.

E. E. Karsak and C. O. Özogul, “An integrated decision making approach for ERP system selection,” Expert Syst. Appl., vol. 36, pp. 660–667, 2009.

H. S. Kilic, S. Zaim, and D. Delen, “Development of a hybrid methodology for ERP system selection: The case of Turkish Airlines,” Decis. Support Syst., vol. 66, pp. 82–92, 2014.

H. S. Kilic, S. Zaim, and D. Delen, “Selecting ‘The Best’ ERP system for SMEs using a combination of ANP and PROMETHEE methods,” Expert Syst. Appl., vol. 42, pp. 2343–2352, 2015.

B. Kitchenham, “Procedures for performing systematic reviews,” Keele, UK, Keele Univ., vol. 33, no. 2004, pp. 1–26, 2004.

P. Kruchten, “An Ontology of Architectural Design Decisions in Software-Intensive Systems,” Proceedings of the 2nd Groningen Workshop on Software Variability Management, 2004. [Online]. Available: http://pkruchten.files.wordpress.com/2009/07/kruchten-2004-design-decisions.pdf. [Accessed: 14-Sep-2014].

D. Kunda, “STACE: social technical approach to COTS software evaluation,” Component-Based Softw. Qual., pp. 64–84, 2003.

M. L. Etaati, S. Sadi-Nezhad, A, “Using Fuzzy Analytical Network Process and ISO 9126 Quality Model in Software Selection: A case study in E-learnig Systems,” Journal of Applied Sciences, vol. 11. pp. 96–103, 2011.

V. S. Lai, B. K. Wong, and W. Cheung, “Group decision making in a multiple criteria environment: A case using the AHP in software selection,” Eur. J. Oper. Res., vol. 137, no. 1, pp. 134–144, Feb. 2002.

L. A. Le Blanc and M. Tawfik Jelassi, “DSS software selection: A multiple criteria decision methodology,” Inf. Manag., vol. 17, no. 1, pp. 49–65, Aug. 1989.

H. S. Lee and M. H. Wang, “A fuzzy model for selecting software,” Proc. - Fourth Int. Conf. Fuzzy Syst. Knowl. Discov. FSKD 2007, vol. 3, no. Fskd, pp. 411–415, 2007.

Y. Li and M. A. Thomas, “A Multiple Criteria Decision Analysis (MCDA) Software Selection Framework,” in 2014 47th Hawaii International Conference on System Sciences, 2014, pp. 1084–1094.

H.-Y. Lin, P.-Y. Hsu, and G.-J. Sheen, “A fuzzy-based decision-making procedure for data warehouse system selection,” Expert Syst. Appl., vol. 32, no. 3, pp. 939–953, Apr. 2007.

T. Mannisto, J. Savolainen, and V. Myllarniemi, “Teaching Software Architecture Design,” in Seventh Working IEEE/IFIP Conference on Software Architecture (WICSA 2008), 2008, pp. 117–124.

V. Maxville, J. Armarego, and C. P. Lam, “Applying a reusable framework for software selection,” IET Softw., vol. 3, no. October 2008, p. 369, 2009.

P. Minetola, L. Iuliano, and F. Calignano, “A customer oriented methodology for reverse engineering software selection in the computer aided inspection scenario,” Comput. Ind., vol. 67, pp. 54–71, 2015.

S. K. Misra and A. Ray, “Integrated AHP-TOPSIS Model for Software Selection Under Multi-criteria Perspective,” Driv. Econ. through Innov. Entrep., pp. 163–174, 2013.

D. Morera, COTS Evaluation Using Desmet Methodology & Analytic Hierarchy Process (AHP), vol. 2559. Berlin, Heidelberg: Springer Berlin Heidelberg, 2002.

B. L. Nelson, W. D. Kelton, and G. M. Clark, “SELECTING SIMULATION SOFTWARE,” 1991.

A. A. Neto and M. Vieira, “Selecting software packages for secure database installations,” Proc. 2011 6th Int. Conf. Availability, Reliab. Secur. ARES 2011, pp. 67–74, 2011.

E. W. T. Ngai and E. W. C. Chan, “Evaluation of knowledge management tools using AHP,” Expert Syst. Appl., vol. 29, no. 4, pp. 889–899, Nov. 2005.

J. Nikoukaran, V. Hlupic, and R. J. Paul, “A hierarchical framework for evaluating simulation software,” Simul. Pract. Theory, vol. 7, no. 3, pp. 219–231, May 1999.

J. Nikoukaran and R. J. Paul, “Software selection for simulation in manufacturing: a review,” Simul. Pract. Theory, vol. 7, no. 1, pp. 1–14, Mar. 1999.

W. Ossadnik and O. Lange, “AHP-based evaluation of AHP-Software,” Eur. J. Oper. Res., vol. 118, no. 3, pp. 578–588, Nov. 1999.

V. F. P and R. Chalmeta, “E-BUSINESS SOFTWARE EVALUATION.”

R. W. Saaty, “The analytic hierarchy process—what it is and how it is used,” Math. Model., vol. 9, no. 3–5, pp. 161–176, Jan. 1987.

T. L. Saaty, “A scaling method for priorities in hierarchical structures,” J. Math. Psychol., vol. 15, no. 3, pp. 234–281, Jun. 1977.

T. L. Saaty, The Analytic Network Process. RWS Publications, 1996.

M. Sarrab and O. M. H. Rehman, “Empirical study of open source software selection for adoption, based on software quality characteristics,” Adv. Eng. Softw., vol. 69, pp. 1–11, Mar. 2014.

A. Shtub, I. Spiegler, and A. Kapeliuk, “Using DSS methods in selecting operations management software,” Comput. Integr. Manuf. Syst., vol. 1, no. 4, pp. 211–220, Nov. 1988.

Z. Siddiqui, A. H. Abdullah, and M. K. Khan, “Qualified analysis b/w ESB(s) using Analytical Hierarchy Process (AHP) method,” Proc. - 2011 2nd Int. Conf. Intell. Syst. Model. Simulation, ISMS 2011, pp. 100–104, 2011.

I. Stamelos, I. Vlahavas, I. Refanidis, and A. Tsoukiàs, “Knowledge based evaluation of software systems: a case study,” Inf. Softw. Technol., vol. 42, no. 5, pp. 333–345, Apr. 2000.

J. Tyree and A. Akerman, “Architecture decisions: Demystifying architecture,” IEEE Softw., vol. 22, no. April, pp. 19–27, 2005.

S. R. V and H. Muccini, “A Study on Group Decision-Making in Software Architecture,” 2014.

P. J. M. van Laarhoven and W. Pedrycz, “A fuzzy extension of Saaty’s priority theory,” Fuzzy Sets Syst., vol. 11, no. 1–3, pp. 199–227, 1983.

J. Verville and A. Halingten, “A six-stage model of the buying process for ERP software,” Ind. Mark. Manag., vol. 32, no. 7, pp. 585–594, Oct. 2003.

C. C. Wei, C. F. Chien, and M. J. J. Wang, “An AHP-based approach to ERP system selection,” Int. J. Prod. Econ., vol. 96, pp. 47–62, 2005.

C.-C. Wei and M.-J. J. Wang, “A comprehensive framework for selecting an ERP system,” Int. J. Proj. Manag., vol. 22, pp. 161–169, 2004.

Xavier Franch and Juan Pablo Carvallo, “Using Quality Models in software package selection,” Ieee Softw., vol. 20, pp. 34–41, 2003.

H. R. Yazgan, S. Boran, and K. Goztepe, “An ERP software selection process with using artificial neural network based on analytic network process approach,” Expert Syst. Appl., vol. 36, no. 5, pp. 9214–9222, 2009.

a. a. Zaidan, B. B. Zaidan, A. Al-Haiqi, M. L. M. Kiah, M. Hussain, and M. Abdulnabi, “Evaluation and selection of open-source EMR software packages based on integrated AHP and TOPSIS,” J. Biomed. Inform., 2014.

Downloads

Published

2015-10-08
Metrics
Views/Downloads
  • Abstract
    185
  • PDF (Español (España))
    49

How to Cite

Rojas Duarte, A. L., Pinzón, Y., & Cortez Aldana, F. A. (2015). Selection of software, a systematic review. INGE@UAN - TENDENCIAS EN LA INGENIERÍA, 5(10). Retrieved from https://revistas.uan.edu.co/index.php/ingeuan/article/view/399

Issue

Vol. 5 No. 10 (2015)

Section

Artículo de revisión

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Metrics