Literature Review on Multi-Criteria Analysis and Application in Education Environment

Authors

  • Ibrahim Alshakhatreh Department of Business Administration, collage of management, National Yunlin University of Science and Technology, 123, University Road, Section 3, Douliu, Yunlin County, Taiwan Author https://orcid.org/0009-0003-5298-2229
  • Dramane Thiombiano Department of Business Administration, collage of management, National Yunlin University of Science and Technology, 123, University Road, Section 3, Douliu, Yunlin County, Taiwan Author https://orcid.org/0009-0001-7835-9094
  • Shahd Al-Majali Department of Business Administration, collage of management, National Yunlin University of Science and Technology, 123, University Road, Section 3, Douliu, Yunlin County, Taiwan Author https://orcid.org/0009-0005-0629-9802

DOI:

https://doi.org/10.31181/jopi21202428

Keywords:

MCDM, Education, Decision Analysis, E-learning, Evaluation

Abstract

Due to the increasing complexity of educational data, the use of decision analysis techniques such as Multi-Criteria Decision Making (MCDM) models has become more popular in the education system in recent years. Multi criteria decision making methods provide data analysis methods faster and more efficient for revealing unhidden patterns and other meaningful information from vast educational data those conventional analytics are unable to discover in a reasonable amount of time. Particularly, MCDM techniques have been demonstrated to be effective methods for pattern recognition in educational systems. Motivated by this consideration, the purpose of this paper is to investigate the MCDM approaches applied to education systems through a review of new architectures, applications, and educational trends. The primary objective of this paper is to provide extensive insight into the application of MCDM models to education solutions in order to bridge the gap between MCDM techniques and human-based education interpretability. Then, the application of MCDM to various aspects of education are categorized. Finally, we present the current open challenges and future directions.

Downloads

Download data is not yet available.

References

Triantaphyllou, E. (2000). Multi-criteria decision-making methods. In Multi-criteria decision making methods: A comparative study (pp. 5–21). Springer. https://doi.org/10.1007/978-1-4757-3157-6_1

Naveed, Q. N., Muhammad, A., Sanober, S., Qureshi, M. R. N., & Shah, A. (2020). Evaluating critical success factors in implementing E-learning system using multi-criteria decision-making. PLOS ONE, 15(5), e0231465. https://doi.org/10.1371/journal.pone.0231465

Malik, D. A. A., Yusof, Y., & Na’im Ku Khalif, K. M. (2021). A view of MCDM application in education. Journal of Physics: Conference Series. 1818(1), 012166. IOP Publishing. https://doi.org/10.1088/1742-6596/1818/1/012166

Geng, R., & Xu, G. (2011). Application of AHP FSE Method in the Network Course Quality Evaluation. Procedia Engineering, 15, 4136–4141. https://doi.org/10.1016/j.proeng.2011.08.776

Chen, C.-H., & Tzeng, G.-H. (2011). Creating the aspired intelligent assessment systems for teaching materials. Expert Systems with Applications, 38(10), 12168–12179. https://doi.org/10.1016/j.eswa.2011.02.022

Tang, H.-W. V. (2014). Constructing a competence model for international professionals in the MICE industry: An analytic hierarchy process approach. Journal of Hospitality, Leisure, Sport & Tourism Education, 15, 34–49. https://doi.org/10.1016/j.jhlste.2014.05.001

Mustafa, A., & Goh, M. (1996). Multi-criterion models for higher education administration. Omega, 24(2), 167–178. https://doi.org/10.1016/0305-0483(95)00053-4

Uysal, S. (2015). Factors affecting the mathematics achievement of Turkish students in PISA 2012. Educational Research and Reviews, 10(12), 1670–1678. https://doi.org/10.5897/ERR2015.2239

Uysal, F. (2015). Evaluation of the factors that determine quality in graduate education: Application of a satisfaction benchmarking approach. Procedia - Social and Behavioral Sciences, 191, 1034–1037. https://doi.org/10.1016/j.sbspro.2015.04.467

Wang, X., Yang, Y., & Wen, X. (2009). Study on blended learning approach for English teaching. In 2009 IEEE International Conference on Systems, Man and Cybernetics (pp. 4664–4667). IEEE. https://doi.org/10.1109/ICSMC.2009.5346820

Xiaomei, W., Yajun, Y., & Xin, W. (2009). Research and design of computer-aided English textbook evaluation system. In 2009 First International Workshop on Education Technology and Computer Science (ETCS '09) (pp. 107–110). IEEE. https://doi.org/10.1109/ETCS.2009.485

Noroozi, M. (2009). Considering and choosing the best applied methods of information technology in educating process by using decision-making techniques. World Applied Sciences Journal, 6(Suppl 1), 28–31. (Unfortunately, I could not find a DOI for this article. You can check directly on the journal's website or use CrossRef.)

Parker, K. R. (2010). Selecting software tools for IS/IT curricula. Education and Information Technologies, 15(4), 255–275. https://doi.org/10.1007/s10639-009-9100-4

Beynon, J. (2005). A sociocultural and critical analysis of educational policies and programs for minority youth in British Columbia. (Working paper).

Beynon, M. J. (2005). A method of aggregation in DS/AHP for group decision-making with the non-equivalent importance of individuals in the group. Computers & Operations Research, 32(7), 1881–1896. https://doi.org/10.1016/j.cor.2003.12.015

Kam, K., Fung, Y., & Manwai, Y. (2012). Department course selection problem: The primitive cognitive network process approach. In 2012 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE) (pp. 1–6). IEEE. https://doi.org/10.1109/TALE.2012.6360314

Hsieh, P.-f. (2013). Curriculum planning of MICE course in continuing education. Journal of Hospitality, Leisure, Sport & Tourism Education, 13, 107–122. https://doi.org/10.1016/j.jhlste.2013.07.001

Erkan, T. E., & Rouyendegh, B. D. (2014). Curriculum change parameters determined by multi-criteria decision making (MCDM). Procedia - Social and Behavioral Sciences, 116, 1744–1747. https://doi.org/10.1016/j.sbspro.2014.01.455

Tang, H.-W. V. (2011). Optimizing an immersion ESL curriculum using analytic hierarchy process. Evaluation and Program Planning, 34(4), 343–352. https://doi.org/10.1016/j.evalprogplan.2011.04.002

Wu, H.-Y., Lin, Y.-K., & Chang, C.-H. (2011). Performance evaluation of extension education centers in universities based on the balanced scorecard. Evaluation and Program Planning, 34(1), 37–50. https://doi.org/10.1016/j.evalprogplan.2010.06.001

Chen, J.-K., & Chen, I.-S. (2012). An Inno-Qual performance system for higher education. Scientometrics, 93(3), 1119–1149. https://doi.org/10.1007/s11192-012-0745-9

Chen, J.-K., & Chen, I.-S. (2012). A network hierarchical feedback system for Taiwanese universities b ased on the integration of total quality management and innovation. Applied Soft Computing, 12(8), 2394–2408. https://doi.org/10.1016/j.asoc.2012.03.058

Tseng, M.-L. (2010). Implementation and performance evaluation using the fuzzy network balanced scorecard. Computers & Education, 55(1), 188–201. https://doi.org/10.1016/j.compedu.2010.01.003

Chen, J.-K., & Chen, I.-S. (2010). Using a novel conjunctive MCDM approach based on DEMATEL, fuzzy ANP, and TOPSIS as an innovation support system for Taiwanese higher education. Expert Systems with Applications, 37(3), 1981–1990. https://doi.org/10.1016/j.eswa.2009.06.079

Chen, J.-K., & Chen, I.-S. (2012). A network hierarchical feedback system for Taiwanese universities based on the integration of total quality management and innovation. https://doi.org/10.1016/j.asoc.2012.03.058

Chen, J.-K., & Chen, I.-S. (2011). Inno-Qual efficiency of higher education: Empirical testing using data envelopment analysis. Expert Systems with Applications, 38(3), 1823–1834. https://doi.org/10.1016/j.compedu.2010.01.003

Wu, H.-Y., Huang, Y.-W., & Hsieh, Y.-T. (2012). Ranking universities based on performance evaluation by a hybrid MCDM model. Measurement, 45(5), 856–880. https://doi.org/10.1016/j.measurement.2011.12.017

Köksalan, M., Onal, H., & Vardar, A. (2010). A flexible approach to ranking with an application to MBA programs. European Journal of Operational Research, 201(2), 470–476. https://doi.org/10.1016/j.ejor.2009.03.011

Ray, W., Jia-Ling, C., & Wei-Ming, H. (2010). Notice of retraction: Investigation on education quality criteria of University of Technology in Taiwan. In Computer Science and Information Technology (ICCSIT), 2010 3rd IEEE International Conference on. IEEE. https://doi.org/10.1109/ICCSIT.2010.5560858

Waheed, B., Ahmed, A., & Mahfouz, A. (2011). Uncertainty-based quantitative assessment of sustainability for higher education institutions. Journal of Cleaner Production, 19(6-7), 720–732. https://doi.org/10.1016/j.jclepro.2010.11.017

Wu, H.-Y., Chen, J.-K., & Chen, I.-S. (2010). Innovation capital indicator assessment of Taiwanese universities: A hybrid fuzzy model application. Expert Systems with Applications, 37(2), 1635–1642. https://doi.org/10.1016/j.eswa.2009.07.025

Lee, S.-H. (2010). Using fuzzy AHP to develop an intellectual capital evaluation model for assessing their performance contribution in a university. Expert Systems with Applications, 37(7), 4941–4947. https://doi.org/10.1016/j.eswa.2010.01.034

Sooreh, L. K., Baghery, R., & Zarei, M. (2011). Defining and measuring entrepreneurial universities: A study in the Iranian context using importance-performance analysis and TOPSIS technique. Global Business and Management Research: An International Journal, 3(2), 182–199.

Jamali, R., & Sayyadi Tooranloo, H. (2009). Prioritizing academic library service quality indicators using fuzzy approach: Case study: Libraries of Ferdowsi University. Library Management, 30(4/5), 319–333. https://doi.org/10.1108/01435120910958871

Lupo, T. (2013). A fuzzy ServQual based method for reliable measurements of education quality in the Italian higher education area. Expert Systems with Applications, 40(17), 7096–7110. https://doi.org/10.1016/j.eswa.2013.07.034

Wongsathan, R., Khaothawirat, A., & Khuankaew, W. (2014). The prioritization for higher education institutions performance criteria with Fuzzy Analytical Hierarchy Process. In Fuzzy Systems (FUZZ-IEEE), 2014 IEEE International Conference on. IEEE. https://doi.org/10.1109/FUZZ-IEEE.2014.6881470

Ho, W., Higson, H. E., & Dey, P. K. (2007). An integrated multiple criteria decision-making approach for resource allocation in higher education. International Journal of Innovation and Learning, 4(5), 471–486. https://doi.org/10.1504/IJIL.2007.014049

Hsu, D. W. L., Hsu, P.-F., & Yang, C. C. (2015). Toward successful commercialization of university technology: Performance drivers of university technology transfer in Taiwan. Technological Forecasting and Social Change, 92, 25–39. https://doi.org/10.1016/j.techfore.2014.09.001

Chen, I. S., & Chen, J.-K. (2012). Creativity strategy selection for the higher education system. Quality & Quantity, 46(3), 739–750. https://doi.org/10.1007/s11135-011-9490-4

Tangian, A. (2004). Redistribution of university budgets with respect to the status quo. European Journal of Operational Research, 157(2), 409–428. https://doi.org/10.1016/S0377-2217(03)00284-5

Rouyendegh, B. D., & Can, G. F. (2012). Selection of working area for industrial engineering students. Procedia - Social and Behavioral Sciences, 31, 20–24. https://doi.org/10.1016/j.sbspro.2011.12.005

Wu, H.-Y., Chen, J.-K., & Chen, I.-S. (2014). Exploring the critical influential factors of creativity for college students: A multiple criteria decision-making approach. Thinking Skills and Creativity, 11, 1–21. https://doi.org/10.1016/j.tsc.2013.11.002

Othman, M. R., Chan, W. Y., & Bin Mohamad, N. (2012). Introducing sustainability assessment and selection (SAS) into chemical engineering education. Education for Chemical Engineers, 7(3), e118-e124. https://doi.org/10.1016/j.ece.2012.05.001

Nasibov, E. N., & Kinay, A. Ö. (2009). An iterative approach for estimation of student performances based on linguistic evaluations. Information Sciences, 179(5), 688–698. https://doi.org/10.1016/j.ins.2008.10.010

Certa, A., Enea, M., & Hopps, F. (2015). A multi-criteria approach for the group assessment of an academic course: A case study. Studies in Educational Evaluation, 44, 16–22. https://doi.org/10.1016/j.stueduc.2015.03.002

Kwok, R.-W., Chan, R., & Wong, S. S. (2007). A fuzzy multi-criteria decision-making model for IS student group project assessment. Group Decision and Negotiation, 16(1), 25–42. https://doi.org/10.1007/s10726-006-9034-8

Ni-Di, Z., & Yi, L. (2010). Comprehensive evaluation of entrepreneurial capacity of college students. In Information Management and Engineering (ICIME), 2010 The 2nd IEEE International Conference on. IEEE. https://doi.org/10.1109/ICIME.2010.5541112

Duanning, Z., Chen, C., Yang, K., & Liu, C. (1999). Fuzzy group decision support system for project assessment. In Systems Sciences, 1999. HICSS-32. Proceedings of the 32nd Annual Hawaii International Conference on. IEEE. https://doi.org/10.1109/HICSS.1999.772655

Chen, J.-F., Hsieh, H.-N., & Do, Q. H. (2015). Evaluating teaching performance based on fuzzy AHP and comprehensive evaluation approach. Applied Soft Computing, 28, 100–108. https://doi.org/10.1016/j.asoc.2014.12.028

Tay, K. M., & Lim, C. P. (2011). A fuzzy inference system-based criterion-referenced assessment model. Expert Systems with Applications, 38(9), 11129–11136. https://doi.org/10.1016/j.eswa.2011.02.126

Do, Q., & Chen, J. (2013). An evaluation of teaching performance: The fuzzy AHP and comprehensive evaluation approach. WSEAS Transactions on Information Science & Applications, 10(3), 90–99.

Meyer, D. (2009). OptAssign—A web-based tool for assigning students to groups. Computers & Education, 53(4), 1104–1119. https://doi.org/10.1016/j.compedu.2009.06.006

Shakouri G, H., & Tavassoli N, Y. (2012). Implementation of a hybrid fuzzy system as a decision support process: A FAHP–FMCDM–FIS composition. Expert Systems with Applications, 39(3), 3682–3691. https://doi.org/10.1016/j.eswa.2011.10.027

Cheng, S.-L., & Chang, H.-C. (2006). Multicriteria automatic essay assessor generation by using TOPSIS model and genetic algorithm. In Intelligent Tutoring Systems. Springer. https://doi.org/10.1007/11774303_28

Yeh, C. H. (2003). The selection of multiattribute decision-making methods for scholarship student selection. International Journal of Selection and Assessment, 11(4), 289–296. https://doi.org/10.1111/1468-2389.233

Kousalya, P., & Reddy, G. (2002). Selection of a student for All Round Excellence Award using fuzzy AHP and TOPSIS methods. International Journal of Engineering, 1(4), 1993–2002.

Ketkar, M., & Vaidya, O. S. (2014). Evaluating and ranking candidates for MBA program: Mahalanobis Taguchi system approach. Procedia Economics and Finance, 11, 654–664. https://doi.org/10.1016/S2212-5671(14)00113-6

Rouyendegh, B. D., & Erkan, T. E. (2011). MBA students’ preference on: Online, formal and hybrid MBA programs. Procedia - Social and Behavioral Sciences, 28, 770–775. https://doi.org/10.1016/j.sbspro.2011.11.144

Smolíková, R., & Wachowiak, M. P. (2002). Aggregation operators for selection problems. Fuzzy Sets and Systems, 131(1), 23–34. https://doi.org/10.1016/S0165-0114(01)00048-2

Fuller, C. C., & R, O. (1997). OWA operators for decision support. Conference Paper. https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=e28a112130b1d4e5b520896f705fbc653450e337

Önder, E., Mert, A., & Tuncer, M. (2014). Identifying the importance level of factors influencing the selection of nursing as a career choice using AHP: Survey to compare the precedence of private vocational high school nursing students and their parents. Procedia - Social and Behavioral Sciences, 122, 398–404. https://doi.org/10.1016/j.sbspro.2014.01.1350

Kamis, N. H., & Shamsuddin, A. (2012). An integrated fuzzy approach to solving multi-criteria decision-making problems. In Humanities, Science and Engineering Research (SHUSER), 2012 IEEE Symposium on. IEEE. https://doi.org/10.1109/SHUSER.2012.6248231

Pavani, S., Sharma, L. K., & Hota, H. S. (2013). A group expert evaluation for teachers by integrating fuzzy AHP and TOPSIS models. In MOOC Innovation and Technology in Education (MITE), 2013 IEEE International Conference. IEEE. https://doi.org/10.1109/MITE.2013.6692560

Bana e Costa, C. A., & Oliveira, M. D. (2012). A multicriteria decision analysis model for faculty evaluation. Omega, 40(4), 424–436. https://doi.org/10.1016/j.omega.2011.11.003

Mazumdar, A., Datta, S., & Mahapatra, S. S. (2010). Multicriteria decision-making models for the evaluation and appraisal of teachers' performance. International Journal of Productivity and Quality Management, 6(2), 213–230. https://doi.org/10.1504/IJPQM.2010.032079

Mazumdar, A. (2009). Application of Multi-Criteria Decision Making (MCDM) Approached on Teachers' Performance Evaluation and Appraisal (Doctoral dissertation).

Li, X., & Li, D. (2011). TOPSIS method for Chinese college teacher performance appraisal system with uncertain information. AISS: Advances in Information Sciences and Service Sciences, 3(6), 59–64.

Norddin, N. I., Ibrahim, K., & Aziz, A. H. (2012). Selecting new lecturers using the Analytical Hierarchy Process (AHP). In Statistics in Science, Business, and Engineering (ICSSBE), 2012 International Conference on. IEEE. https://doi.org/10.1109/ICSSBE.2012.6244272

Ray, S., & Marakas, G. (2007). Selecting a doctoral dissertation supervisor: Analytical hierarchy approach to the multiple criteria problem. International Journal of Doctoral Studies, 2, 23–32.

Organ, A. (2013). Practice over the private teaching institutions selection problem in one of the secondary schools using multiple attribute decision-making method of TOPSIS. Procedia - Social and Behavioral Sciences, 89, 489–495. https://doi.org/10.1016/j.sbspro.2013.08.003

Shee, D. Y., & Wang, Y.-S. (2008). Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications. Computers & Education, 50(3), 894–905. https://doi.org/10.1016/j.compedu.2007.08.002

Lin, H.-F. (2010). An application of fuzzy AHP for evaluating course website quality. Computers & Education, 54(4), 877–888. https://doi.org/10.1016/j.compedu.2009.10.002

Tzeng, G.-H., Chiang, C.-H., & Li, C.-W. (2007). Evaluating intertwined effects in e-learning programs: A novel hybrid MCDM model based on factor analysis and DEMATEL. Expert Systems with Applications, 32(4), 1028–1044. https://doi.org/10.1016/j.eswa.2006.02.017

Chao, R.-J., & Chen, Y.-H. (2009). Evaluation of the criteria and effectiveness of distance e-learning with consistent fuzzy preference relations. Expert Systems with Applications, 36(7), 10657–10662. https://doi.org/10.1016/j.eswa.2009.02.019

Cavus, N. (2010). The evaluation of learning management systems using an artificial intelligence fuzzy logic algorithm. Advances in Engineering Software, 41(2), 248–254. https://doi.org/10.1016/j.advengsoft.2009.06.004

Chen-Shu, W., & Shiang-Lin. (2012). Combining fuzzy AHP and association rule to evaluate the activity processes of e-learning system. In Genetic and Evolutionary Computing (ICGEC), 2012 Sixth International Conference on. IEEE. https://doi.org/10.1109/ICGEC.2012.49

Colace, F., De Santo, M., & Pietrosanto, A. (2006). Evaluation models for e-learning platform: An AHP approach. In Frontiers in Education Conference, 36th Annual. https://ieeexplore.ieee.org/abstract/document/4116906/

Kaklauskas, A., Zavadskas, E. K., & Budzevičiene, R. (2009). Web‐based model of multiple criteria ethical decision‐making for ethical behaviour of students. Journal of Business Economics and Management, 10(1), 71–84. https://doi.org/10.3846/1611-1699.2009.10.71-84

Hwang, G.-J., Huang, T. C. K., & Tseng, J. C. R. (2004). A group-decision approach for evaluating educational web sites. Computers & Education, 42(1), 65–86. https://doi.org/10.1016/j.compedu.2003.06.003

Jeong, H.-Y., Choi, C.-R., & Song, Y.-J. (2012). Personalized learning course planner with e-learning DSS using user profile. Expert Systems with Applications, 39(3), 2567–2577. https://doi.org/10.1016/j.eswa.2011.08.031

Sharma, R., Banati, H., & Bedi, P. (2011). Incorporating social opinion in content selection for an e-learning course. In Computer Science & Education (ICCSE), 2011 6th International Conference on. IEEE. https://doi.org/10.1109/ICCSE.2011.6028531

Renata, B., & Jana, M. (2012). Learning and teaching with technology: E-learning as a motivation in teaching physics. Procedia - Social and Behavioral Sciences, 64, 328–331. https://doi.org/10.1016/j.sbspro.2012.11.039

Wu, H.-Y., & Lin, H.-Y. (2012). A hybrid approach to develop an analytical model for enhancing the service quality of e-learning. Computers & Education, 58(4), 1318–1338. https://doi.org/10.1016/j.compedu.2011.11.009

Begicevic, N., Divjak, B., & Hunjak, T. (2009). Decision making on project selection in higher education sector using the analytic hierarchy process. In Information Technology Interfaces, 2009. ITI '09. Proceedings of the ITI 2009 31st International Conference on. IEEE. https://doi.org/10.1109/ITI.2009.5190987

Melón, M. G., Aragonés Beltran, P., & González Cruz, M. C. (2008). An AHP-based evaluation procedure for innovative educational projects: A face-to-face vs. computer-mediated case study. Omega, 36(5), 754–765. https://doi.org/10.1016/j.omega.2007.03.004

Jablonský, J. (2009). Software support for multiple criteria decision making problems. Management Information Systems, 4(2), 29–34. https://doi.org/10.21511/management.4(2).2009.03

Perzina, R., & Ramík, J. (2014). Microsoft Excel as a tool for solving multicriteria decision problems. Procedia Computer Science, 35, 1455–1463. https://doi.org/10.1016/j.procs.2014.08.250

Jablonský, J. (2009). Software support for multiple criteria decision making problems. Management, 4(2), 29–3. https://doi.org/10.21511/management.4(2).2009.03

Perzina, R., & Ramik, J. (2012). DAME-Microsoft Excel add-in for solving multicriteria decision problems with scenarios. In Proceedings of the 30th International Conference Mathematical Methods in Economics. https://www.opf.slu.cz/kmme/DAME/DAME_en.pdf

Badaracco, M., & Martínez, L. (2013). A fuzzy linguistic algorithm for adaptive test in intelligent tutoring systems based on competences. Expert Systems with Applications, 40(8), 3073–3086. https://doi.org/10.1016/j.eswa.2013.01.023

Ho, W., Dey, P. K., & Higson, H. E. (2006). Multiple criteria decision-making techniques in higher education. International Journal of Educational Management, 20(5), 319–337. https://doi.org/10.1108/09513540610690018

Published

2024-10-13

How to Cite

Alshakhatreh, I., Thiombiano, D., & Al-Majali, S. . (2024). Literature Review on Multi-Criteria Analysis and Application in Education Environment. Journal of Operations Intelligence, 2(1), 236-267. https://doi.org/10.31181/jopi21202428