Literature Review on Multi-Criteria Analysis and Application in Education Environment
DOI:
https://doi.org/10.31181/jopi21202428Keywords:
MCDM, Education, Decision Analysis, E-learning, EvaluationAbstract
Due to the increasing complexity of educational data, the use of decision analysis techniques such as Multi-Criteria Decision Making (MCDM) models has become more popular in the education system in recent years. Multi criteria decision making methods provide data analysis methods faster and more efficient for revealing unhidden patterns and other meaningful information from vast educational data those conventional analytics are unable to discover in a reasonable amount of time. Particularly, MCDM techniques have been demonstrated to be effective methods for pattern recognition in educational systems. Motivated by this consideration, the purpose of this paper is to investigate the MCDM approaches applied to education systems through a review of new architectures, applications, and educational trends. The primary objective of this paper is to provide extensive insight into the application of MCDM models to education solutions in order to bridge the gap between MCDM techniques and human-based education interpretability. Then, the application of MCDM to various aspects of education are categorized. Finally, we present the current open challenges and future directions.
Downloads
References
Triantaphyllou, E. (2000). Multi-criteria decision-making methods. In Multi-criteria decision making methods: A comparative study (pp. 5–21). Springer. https://doi.org/10.1007/978-1-4757-3157-6_1
Naveed, Q. N., Muhammad, A., Sanober, S., Qureshi, M. R. N., & Shah, A. (2020). Evaluating critical success factors in implementing E-learning system using multi-criteria decision-making. PLOS ONE, 15(5), e0231465. https://doi.org/10.1371/journal.pone.0231465
Malik, D. A. A., Yusof, Y., & Na’im Ku Khalif, K. M. (2021). A view of MCDM application in education. Journal of Physics: Conference Series. 1818(1), 012166. IOP Publishing. https://doi.org/10.1088/1742-6596/1818/1/012166
Geng, R., & Xu, G. (2011). Application of AHP FSE Method in the Network Course Quality Evaluation. Procedia Engineering, 15, 4136–4141. https://doi.org/10.1016/j.proeng.2011.08.776
Chen, C.-H., & Tzeng, G.-H. (2011). Creating the aspired intelligent assessment systems for teaching materials. Expert Systems with Applications, 38(10), 12168–12179. https://doi.org/10.1016/j.eswa.2011.02.022
Tang, H.-W. V. (2014). Constructing a competence model for international professionals in the MICE industry: An analytic hierarchy process approach. Journal of Hospitality, Leisure, Sport & Tourism Education, 15, 34–49. https://doi.org/10.1016/j.jhlste.2014.05.001
Mustafa, A., & Goh, M. (1996). Multi-criterion models for higher education administration. Omega, 24(2), 167–178. https://doi.org/10.1016/0305-0483(95)00053-4
Uysal, S. (2015). Factors affecting the mathematics achievement of Turkish students in PISA 2012. Educational Research and Reviews, 10(12), 1670–1678. https://doi.org/10.5897/ERR2015.2239
Uysal, F. (2015). Evaluation of the factors that determine quality in graduate education: Application of a satisfaction benchmarking approach. Procedia - Social and Behavioral Sciences, 191, 1034–1037. https://doi.org/10.1016/j.sbspro.2015.04.467
Wang, X., Yang, Y., & Wen, X. (2009). Study on blended learning approach for English teaching. In 2009 IEEE International Conference on Systems, Man and Cybernetics (pp. 4664–4667). IEEE. https://doi.org/10.1109/ICSMC.2009.5346820
Xiaomei, W., Yajun, Y., & Xin, W. (2009). Research and design of computer-aided English textbook evaluation system. In 2009 First International Workshop on Education Technology and Computer Science (ETCS '09) (pp. 107–110). IEEE. https://doi.org/10.1109/ETCS.2009.485
Noroozi, M. (2009). Considering and choosing the best applied methods of information technology in educating process by using decision-making techniques. World Applied Sciences Journal, 6(Suppl 1), 28–31. (Unfortunately, I could not find a DOI for this article. You can check directly on the journal's website or use CrossRef.)
Parker, K. R. (2010). Selecting software tools for IS/IT curricula. Education and Information Technologies, 15(4), 255–275. https://doi.org/10.1007/s10639-009-9100-4
Beynon, J. (2005). A sociocultural and critical analysis of educational policies and programs for minority youth in British Columbia. (Working paper).
Beynon, M. J. (2005). A method of aggregation in DS/AHP for group decision-making with the non-equivalent importance of individuals in the group. Computers & Operations Research, 32(7), 1881–1896. https://doi.org/10.1016/j.cor.2003.12.015
Kam, K., Fung, Y., & Manwai, Y. (2012). Department course selection problem: The primitive cognitive network process approach. In 2012 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE) (pp. 1–6). IEEE. https://doi.org/10.1109/TALE.2012.6360314
Hsieh, P.-f. (2013). Curriculum planning of MICE course in continuing education. Journal of Hospitality, Leisure, Sport & Tourism Education, 13, 107–122. https://doi.org/10.1016/j.jhlste.2013.07.001
Erkan, T. E., & Rouyendegh, B. D. (2014). Curriculum change parameters determined by multi-criteria decision making (MCDM). Procedia - Social and Behavioral Sciences, 116, 1744–1747. https://doi.org/10.1016/j.sbspro.2014.01.455
Tang, H.-W. V. (2011). Optimizing an immersion ESL curriculum using analytic hierarchy process. Evaluation and Program Planning, 34(4), 343–352. https://doi.org/10.1016/j.evalprogplan.2011.04.002
Wu, H.-Y., Lin, Y.-K., & Chang, C.-H. (2011). Performance evaluation of extension education centers in universities based on the balanced scorecard. Evaluation and Program Planning, 34(1), 37–50. https://doi.org/10.1016/j.evalprogplan.2010.06.001
Chen, J.-K., & Chen, I.-S. (2012). An Inno-Qual performance system for higher education. Scientometrics, 93(3), 1119–1149. https://doi.org/10.1007/s11192-012-0745-9
Chen, J.-K., & Chen, I.-S. (2012). A network hierarchical feedback system for Taiwanese universities b ased on the integration of total quality management and innovation. Applied Soft Computing, 12(8), 2394–2408. https://doi.org/10.1016/j.asoc.2012.03.058
Tseng, M.-L. (2010). Implementation and performance evaluation using the fuzzy network balanced scorecard. Computers & Education, 55(1), 188–201. https://doi.org/10.1016/j.compedu.2010.01.003
Chen, J.-K., & Chen, I.-S. (2010). Using a novel conjunctive MCDM approach based on DEMATEL, fuzzy ANP, and TOPSIS as an innovation support system for Taiwanese higher education. Expert Systems with Applications, 37(3), 1981–1990. https://doi.org/10.1016/j.eswa.2009.06.079
Chen, J.-K., & Chen, I.-S. (2012). A network hierarchical feedback system for Taiwanese universities based on the integration of total quality management and innovation. https://doi.org/10.1016/j.asoc.2012.03.058
Chen, J.-K., & Chen, I.-S. (2011). Inno-Qual efficiency of higher education: Empirical testing using data envelopment analysis. Expert Systems with Applications, 38(3), 1823–1834. https://doi.org/10.1016/j.compedu.2010.01.003
Wu, H.-Y., Huang, Y.-W., & Hsieh, Y.-T. (2012). Ranking universities based on performance evaluation by a hybrid MCDM model. Measurement, 45(5), 856–880. https://doi.org/10.1016/j.measurement.2011.12.017
Köksalan, M., Onal, H., & Vardar, A. (2010). A flexible approach to ranking with an application to MBA programs. European Journal of Operational Research, 201(2), 470–476. https://doi.org/10.1016/j.ejor.2009.03.011
Ray, W., Jia-Ling, C., & Wei-Ming, H. (2010). Notice of retraction: Investigation on education quality criteria of University of Technology in Taiwan. In Computer Science and Information Technology (ICCSIT), 2010 3rd IEEE International Conference on. IEEE. https://doi.org/10.1109/ICCSIT.2010.5560858
Waheed, B., Ahmed, A., & Mahfouz, A. (2011). Uncertainty-based quantitative assessment of sustainability for higher education institutions. Journal of Cleaner Production, 19(6-7), 720–732. https://doi.org/10.1016/j.jclepro.2010.11.017
Wu, H.-Y., Chen, J.-K., & Chen, I.-S. (2010). Innovation capital indicator assessment of Taiwanese universities: A hybrid fuzzy model application. Expert Systems with Applications, 37(2), 1635–1642. https://doi.org/10.1016/j.eswa.2009.07.025
Lee, S.-H. (2010). Using fuzzy AHP to develop an intellectual capital evaluation model for assessing their performance contribution in a university. Expert Systems with Applications, 37(7), 4941–4947. https://doi.org/10.1016/j.eswa.2010.01.034
Sooreh, L. K., Baghery, R., & Zarei, M. (2011). Defining and measuring entrepreneurial universities: A study in the Iranian context using importance-performance analysis and TOPSIS technique. Global Business and Management Research: An International Journal, 3(2), 182–199.
Jamali, R., & Sayyadi Tooranloo, H. (2009). Prioritizing academic library service quality indicators using fuzzy approach: Case study: Libraries of Ferdowsi University. Library Management, 30(4/5), 319–333. https://doi.org/10.1108/01435120910958871
Lupo, T. (2013). A fuzzy ServQual based method for reliable measurements of education quality in the Italian higher education area. Expert Systems with Applications, 40(17), 7096–7110. https://doi.org/10.1016/j.eswa.2013.07.034
Wongsathan, R., Khaothawirat, A., & Khuankaew, W. (2014). The prioritization for higher education institutions performance criteria with Fuzzy Analytical Hierarchy Process. In Fuzzy Systems (FUZZ-IEEE), 2014 IEEE International Conference on. IEEE. https://doi.org/10.1109/FUZZ-IEEE.2014.6881470
Ho, W., Higson, H. E., & Dey, P. K. (2007). An integrated multiple criteria decision-making approach for resource allocation in higher education. International Journal of Innovation and Learning, 4(5), 471–486. https://doi.org/10.1504/IJIL.2007.014049
Hsu, D. W. L., Hsu, P.-F., & Yang, C. C. (2015). Toward successful commercialization of university technology: Performance drivers of university technology transfer in Taiwan. Technological Forecasting and Social Change, 92, 25–39. https://doi.org/10.1016/j.techfore.2014.09.001
Chen, I. S., & Chen, J.-K. (2012). Creativity strategy selection for the higher education system. Quality & Quantity, 46(3), 739–750. https://doi.org/10.1007/s11135-011-9490-4
Tangian, A. (2004). Redistribution of university budgets with respect to the status quo. European Journal of Operational Research, 157(2), 409–428. https://doi.org/10.1016/S0377-2217(03)00284-5
Rouyendegh, B. D., & Can, G. F. (2012). Selection of working area for industrial engineering students. Procedia - Social and Behavioral Sciences, 31, 20–24. https://doi.org/10.1016/j.sbspro.2011.12.005
Wu, H.-Y., Chen, J.-K., & Chen, I.-S. (2014). Exploring the critical influential factors of creativity for college students: A multiple criteria decision-making approach. Thinking Skills and Creativity, 11, 1–21. https://doi.org/10.1016/j.tsc.2013.11.002
Othman, M. R., Chan, W. Y., & Bin Mohamad, N. (2012). Introducing sustainability assessment and selection (SAS) into chemical engineering education. Education for Chemical Engineers, 7(3), e118-e124. https://doi.org/10.1016/j.ece.2012.05.001
Nasibov, E. N., & Kinay, A. Ö. (2009). An iterative approach for estimation of student performances based on linguistic evaluations. Information Sciences, 179(5), 688–698. https://doi.org/10.1016/j.ins.2008.10.010
Certa, A., Enea, M., & Hopps, F. (2015). A multi-criteria approach for the group assessment of an academic course: A case study. Studies in Educational Evaluation, 44, 16–22. https://doi.org/10.1016/j.stueduc.2015.03.002
Kwok, R.-W., Chan, R., & Wong, S. S. (2007). A fuzzy multi-criteria decision-making model for IS student group project assessment. Group Decision and Negotiation, 16(1), 25–42. https://doi.org/10.1007/s10726-006-9034-8
Ni-Di, Z., & Yi, L. (2010). Comprehensive evaluation of entrepreneurial capacity of college students. In Information Management and Engineering (ICIME), 2010 The 2nd IEEE International Conference on. IEEE. https://doi.org/10.1109/ICIME.2010.5541112
Duanning, Z., Chen, C., Yang, K., & Liu, C. (1999). Fuzzy group decision support system for project assessment. In Systems Sciences, 1999. HICSS-32. Proceedings of the 32nd Annual Hawaii International Conference on. IEEE. https://doi.org/10.1109/HICSS.1999.772655
Chen, J.-F., Hsieh, H.-N., & Do, Q. H. (2015). Evaluating teaching performance based on fuzzy AHP and comprehensive evaluation approach. Applied Soft Computing, 28, 100–108. https://doi.org/10.1016/j.asoc.2014.12.028
Tay, K. M., & Lim, C. P. (2011). A fuzzy inference system-based criterion-referenced assessment model. Expert Systems with Applications, 38(9), 11129–11136. https://doi.org/10.1016/j.eswa.2011.02.126
Do, Q., & Chen, J. (2013). An evaluation of teaching performance: The fuzzy AHP and comprehensive evaluation approach. WSEAS Transactions on Information Science & Applications, 10(3), 90–99.
Meyer, D. (2009). OptAssign—A web-based tool for assigning students to groups. Computers & Education, 53(4), 1104–1119. https://doi.org/10.1016/j.compedu.2009.06.006
Shakouri G, H., & Tavassoli N, Y. (2012). Implementation of a hybrid fuzzy system as a decision support process: A FAHP–FMCDM–FIS composition. Expert Systems with Applications, 39(3), 3682–3691. https://doi.org/10.1016/j.eswa.2011.10.027
Cheng, S.-L., & Chang, H.-C. (2006). Multicriteria automatic essay assessor generation by using TOPSIS model and genetic algorithm. In Intelligent Tutoring Systems. Springer. https://doi.org/10.1007/11774303_28
Yeh, C. H. (2003). The selection of multiattribute decision-making methods for scholarship student selection. International Journal of Selection and Assessment, 11(4), 289–296. https://doi.org/10.1111/1468-2389.233
Kousalya, P., & Reddy, G. (2002). Selection of a student for All Round Excellence Award using fuzzy AHP and TOPSIS methods. International Journal of Engineering, 1(4), 1993–2002.
Ketkar, M., & Vaidya, O. S. (2014). Evaluating and ranking candidates for MBA program: Mahalanobis Taguchi system approach. Procedia Economics and Finance, 11, 654–664. https://doi.org/10.1016/S2212-5671(14)00113-6
Rouyendegh, B. D., & Erkan, T. E. (2011). MBA students’ preference on: Online, formal and hybrid MBA programs. Procedia - Social and Behavioral Sciences, 28, 770–775. https://doi.org/10.1016/j.sbspro.2011.11.144
Smolíková, R., & Wachowiak, M. P. (2002). Aggregation operators for selection problems. Fuzzy Sets and Systems, 131(1), 23–34. https://doi.org/10.1016/S0165-0114(01)00048-2
Fuller, C. C., & R, O. (1997). OWA operators for decision support. Conference Paper. https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=e28a112130b1d4e5b520896f705fbc653450e337
Önder, E., Mert, A., & Tuncer, M. (2014). Identifying the importance level of factors influencing the selection of nursing as a career choice using AHP: Survey to compare the precedence of private vocational high school nursing students and their parents. Procedia - Social and Behavioral Sciences, 122, 398–404. https://doi.org/10.1016/j.sbspro.2014.01.1350
Kamis, N. H., & Shamsuddin, A. (2012). An integrated fuzzy approach to solving multi-criteria decision-making problems. In Humanities, Science and Engineering Research (SHUSER), 2012 IEEE Symposium on. IEEE. https://doi.org/10.1109/SHUSER.2012.6248231
Pavani, S., Sharma, L. K., & Hota, H. S. (2013). A group expert evaluation for teachers by integrating fuzzy AHP and TOPSIS models. In MOOC Innovation and Technology in Education (MITE), 2013 IEEE International Conference. IEEE. https://doi.org/10.1109/MITE.2013.6692560
Bana e Costa, C. A., & Oliveira, M. D. (2012). A multicriteria decision analysis model for faculty evaluation. Omega, 40(4), 424–436. https://doi.org/10.1016/j.omega.2011.11.003
Mazumdar, A., Datta, S., & Mahapatra, S. S. (2010). Multicriteria decision-making models for the evaluation and appraisal of teachers' performance. International Journal of Productivity and Quality Management, 6(2), 213–230. https://doi.org/10.1504/IJPQM.2010.032079
Mazumdar, A. (2009). Application of Multi-Criteria Decision Making (MCDM) Approached on Teachers' Performance Evaluation and Appraisal (Doctoral dissertation).
Li, X., & Li, D. (2011). TOPSIS method for Chinese college teacher performance appraisal system with uncertain information. AISS: Advances in Information Sciences and Service Sciences, 3(6), 59–64.
Norddin, N. I., Ibrahim, K., & Aziz, A. H. (2012). Selecting new lecturers using the Analytical Hierarchy Process (AHP). In Statistics in Science, Business, and Engineering (ICSSBE), 2012 International Conference on. IEEE. https://doi.org/10.1109/ICSSBE.2012.6244272
Ray, S., & Marakas, G. (2007). Selecting a doctoral dissertation supervisor: Analytical hierarchy approach to the multiple criteria problem. International Journal of Doctoral Studies, 2, 23–32.
Organ, A. (2013). Practice over the private teaching institutions selection problem in one of the secondary schools using multiple attribute decision-making method of TOPSIS. Procedia - Social and Behavioral Sciences, 89, 489–495. https://doi.org/10.1016/j.sbspro.2013.08.003
Shee, D. Y., & Wang, Y.-S. (2008). Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications. Computers & Education, 50(3), 894–905. https://doi.org/10.1016/j.compedu.2007.08.002
Lin, H.-F. (2010). An application of fuzzy AHP for evaluating course website quality. Computers & Education, 54(4), 877–888. https://doi.org/10.1016/j.compedu.2009.10.002
Tzeng, G.-H., Chiang, C.-H., & Li, C.-W. (2007). Evaluating intertwined effects in e-learning programs: A novel hybrid MCDM model based on factor analysis and DEMATEL. Expert Systems with Applications, 32(4), 1028–1044. https://doi.org/10.1016/j.eswa.2006.02.017
Chao, R.-J., & Chen, Y.-H. (2009). Evaluation of the criteria and effectiveness of distance e-learning with consistent fuzzy preference relations. Expert Systems with Applications, 36(7), 10657–10662. https://doi.org/10.1016/j.eswa.2009.02.019
Cavus, N. (2010). The evaluation of learning management systems using an artificial intelligence fuzzy logic algorithm. Advances in Engineering Software, 41(2), 248–254. https://doi.org/10.1016/j.advengsoft.2009.06.004
Chen-Shu, W., & Shiang-Lin. (2012). Combining fuzzy AHP and association rule to evaluate the activity processes of e-learning system. In Genetic and Evolutionary Computing (ICGEC), 2012 Sixth International Conference on. IEEE. https://doi.org/10.1109/ICGEC.2012.49
Colace, F., De Santo, M., & Pietrosanto, A. (2006). Evaluation models for e-learning platform: An AHP approach. In Frontiers in Education Conference, 36th Annual. https://ieeexplore.ieee.org/abstract/document/4116906/
Kaklauskas, A., Zavadskas, E. K., & Budzevičiene, R. (2009). Web‐based model of multiple criteria ethical decision‐making for ethical behaviour of students. Journal of Business Economics and Management, 10(1), 71–84. https://doi.org/10.3846/1611-1699.2009.10.71-84
Hwang, G.-J., Huang, T. C. K., & Tseng, J. C. R. (2004). A group-decision approach for evaluating educational web sites. Computers & Education, 42(1), 65–86. https://doi.org/10.1016/j.compedu.2003.06.003
Jeong, H.-Y., Choi, C.-R., & Song, Y.-J. (2012). Personalized learning course planner with e-learning DSS using user profile. Expert Systems with Applications, 39(3), 2567–2577. https://doi.org/10.1016/j.eswa.2011.08.031
Sharma, R., Banati, H., & Bedi, P. (2011). Incorporating social opinion in content selection for an e-learning course. In Computer Science & Education (ICCSE), 2011 6th International Conference on. IEEE. https://doi.org/10.1109/ICCSE.2011.6028531
Renata, B., & Jana, M. (2012). Learning and teaching with technology: E-learning as a motivation in teaching physics. Procedia - Social and Behavioral Sciences, 64, 328–331. https://doi.org/10.1016/j.sbspro.2012.11.039
Wu, H.-Y., & Lin, H.-Y. (2012). A hybrid approach to develop an analytical model for enhancing the service quality of e-learning. Computers & Education, 58(4), 1318–1338. https://doi.org/10.1016/j.compedu.2011.11.009
Begicevic, N., Divjak, B., & Hunjak, T. (2009). Decision making on project selection in higher education sector using the analytic hierarchy process. In Information Technology Interfaces, 2009. ITI '09. Proceedings of the ITI 2009 31st International Conference on. IEEE. https://doi.org/10.1109/ITI.2009.5190987
Melón, M. G., Aragonés Beltran, P., & González Cruz, M. C. (2008). An AHP-based evaluation procedure for innovative educational projects: A face-to-face vs. computer-mediated case study. Omega, 36(5), 754–765. https://doi.org/10.1016/j.omega.2007.03.004
Jablonský, J. (2009). Software support for multiple criteria decision making problems. Management Information Systems, 4(2), 29–34. https://doi.org/10.21511/management.4(2).2009.03
Perzina, R., & Ramík, J. (2014). Microsoft Excel as a tool for solving multicriteria decision problems. Procedia Computer Science, 35, 1455–1463. https://doi.org/10.1016/j.procs.2014.08.250
Jablonský, J. (2009). Software support for multiple criteria decision making problems. Management, 4(2), 29–3. https://doi.org/10.21511/management.4(2).2009.03
Perzina, R., & Ramik, J. (2012). DAME-Microsoft Excel add-in for solving multicriteria decision problems with scenarios. In Proceedings of the 30th International Conference Mathematical Methods in Economics. https://www.opf.slu.cz/kmme/DAME/DAME_en.pdf
Badaracco, M., & Martínez, L. (2013). A fuzzy linguistic algorithm for adaptive test in intelligent tutoring systems based on competences. Expert Systems with Applications, 40(8), 3073–3086. https://doi.org/10.1016/j.eswa.2013.01.023
Ho, W., Dey, P. K., & Higson, H. E. (2006). Multiple criteria decision-making techniques in higher education. International Journal of Educational Management, 20(5), 319–337. https://doi.org/10.1108/09513540610690018
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Journal of Operations Intelligence
This work is licensed under a Creative Commons Attribution 4.0 International License.
