Commonality and differentiation of the concept of evaluation culture in university systems in order to develop human-social capital

Document Type : Research/Original/Regular

Authors

1 Department of Assessment and Measurement, University of Tehran

2 Faculty of Psychology and Education, University of Tehran

10.22059/jscm.2023.364330.2441

Abstract

Purpose: Evaluation culture, with its diverse roles, impacts organizational performance and mission achievement. Alignment with missions, conditions, resources, and organizational maturity is crucial. Effective integration drives excellence and intelligent progress. This study explores evaluation culture, analyzing commonalities and variations among University of Tehran stakeholders.
Research method: The current research method was interpretive phenomenology and its participants included four categories of stakeholders including: faculty members, employees, managers and students of Tehran University, who were selected and saturated by sampling method after 61 semi-structured interviews. The finding was obtained.
Findings: Analysis in the conceptual commonalities section led to the identification of 79 indicators and their classification in the form of 19 criteria. Each of the studied groups believed in a different evaluation culture. In terms of academic stakeholders, each group believed in a different evaluation culture, and in terms of differences in educational groups; Faculty of Engineering and Technology believes in result-oriented evaluation culture, Faculty of Management and Architecture believes in wrist-based evaluation culture; Faculty of Medicine and Veterinary Medicine believes in the evaluation culture based on the development of people; The Faculty of Basic Sciences and Psychology and Education believed in the culture of responsive evaluation and the Faculty of Literature and Humanities believed in the culture of documentary evaluation.
Conclusion: Evaluation culture is a multi-dimensional problem and its implementation in organizations requires attention to the structure of each organization and its perspectives.

Keywords

Main Subjects


آذری، علی‌رضا و زمانی‌مزده، مهدی (1393). الگوی راهبردی مدیریت عملکرد سازمان. مؤسسة آموزشی و تحقیقات صنایع دفاعی، تهران.
بازرگان، عباس (1398). ارزیابی کیفیت در آموزش عالی ایران از اندیشه تا عمل. تهران: پژوهشکدة مطالعات فرهنگی و اجتماعی.
بنی‌سی، پریناز؛ دلفان‌آذری، قنبر‌علی و رشاد، فائقه (1396). نگاهی نو به برنامه‌ریزی آموزشی و درسی در هزارة سوم. تهران: آوای نور.
خاتمی، سیده مریم؛ رجبه‌فرجاد، حاجیه و چهارمحالی، حسن (1393). ارزیابی سیستم ارزشیابی عملکرد کارکنان سازمان و ارائة الگوی پیشنهادی (مطالعة موردی). مطالعات منابع انسانی، 3(11)، 129 ـ 148.
خادم‌محترم، خلیل و سلیمی، مهتاب (1398). ارزشیابی و تضمین کیفیت در نظام آموزش عالی. مطالعات کاربردی در علوم مدیریت و توسعه، 4(15)، 34 ـ 47.
مالمیر، مرتضی؛ صالحی، کیوان؛ مقدم‌زاده، علی و دهقانی، مرضیه (1400). ابعاد و سطوح فرهنگ کیفیت در نظام آموزش عالی: مروری منظم. مطالعات اندازه‌گیری و ارزشیابی آموزشی، 11(36)، 29 ـ 53. doi: 10.22034/emes.2021.251556
مالمیر، مرتضی؛ صالحی، کیوان؛ مقدم‌زاده، علی و دهقانی، مرضیه (1402). معنا و مفهوم فرهنگ کیفیت از منظر ذی‌نفعان در دانشگاه تهران. مدیریت فرهنگ سازمانی، 21، doi: 10.22059/jomc.2023.364285.1008585
محمدزاده، زینب و صالحی، کیوان (1395). تبیین پدیدة نشاط و پویایی علمی در مراکز علمی از منظر نخبگان دانشگاهی: مطالعه‌ای با رویکرد پدیدارشناسی. راهبرد، 2(25)، 227 ـ 258. https://rahbord.csr.ir/article_124595.html?lang=en
محمدزاده، زینب و صالحی، کیوان (1394). آسیب‌شناسی نشاط و پویایی علمی در مراکز علمی و دانشگاهی. سیاست‌های کلان و راهبردی. 3(11)، 1 ـ 25. https://www.jmsp.ir/article_11013.html?lang=en
محمدزاده، زینب و صالحی، کیوان (1402). ارائة نظریه‌ای داده‌بنیاد برای تبیین فرایند شکل‌گیری نشاط و پویایی علمی در دانشگاه‌ها و مراکز علمی. اندیشة مدیریت راهبردی، 17(2)، 39 ـ 76. hthttps://smt.isu.ac.ir/article_76755.html
Aburizaizah, S. J. (2022). The role of quality assurance in Saudi higher education institutions. International Journal of Educational Research Open, 3, https://doi.org/10.1016/j.ijedro.2022.100127.
Alkin, M. C. & King, J. A. (2016). The Historical Development of Evaluation Use. American Journal of Evaluation, 37(4), 568–579. https://doi.org/10.1177/1098214016665164.
Almaamari, Q. A. & Alaswad, H. I. (2021). Factors Influencing Employees' Productivity-Literature Review. Turkish Online Journal of Qualitative Inquiry, 12(6), 5945-5951.
Azari, A. & Zamani, M. (2013). Organizational Performance Management Strategic Model. Tehran: Defense Industries Training and Research Institute. (in Persian)
Bakas, D., Kostis, P., & Petrakis, P. (2020). Culture and labour productivity: An empirical investigation. Economic Modelling, 85, 233-243.‏
Bamber, C.J. & Elezi, E. (2020). What culture is your university? Have universities any right to teach entrepreneurialism?. Higher Education Evaluation and Development, 14, 19-32. https://doi.org/10.1108/HEED-09-2018-0021.
Bani si, P., Delfan Azari, G.A., & Reshad, F. (2014). A new look at educational and lesson planning in the third millennium. Tehran: Avaynoor. (in Persian)
Bazargan, A. (2018). Evaluation of quality in Iran's higher education from thought to practice. Tehran: Research Institute of Cultural and Social Studies. (in Persian)
Bhugra, D., Watson, C., & Ventriglio, A. (2021). Migration, cultural capital and acculturation. International review of psychiatry (Abingdon, England), 33(1-2), 126–131.
Braga, M., Paccagnella, M., & Pellizari, M. (2014). Evaluating students’ evaluations of professors. Economics of Education Review, 41, 77-88.
Bwachele, V.W., Chong, YL., & Krishnapillai, G. (2023). Perceived service quality and student satisfaction in higher learning institutions in Tanzania. Humanit Soc Sci Commun, 10. https://doi.org/10.1057/s41599-023-01913-6.
Dahler-Larsen. P. & Boodhoo, A. (2019). Evaluation culture and good governance: Is there a link?. Evaluation, 6, 1-17. https://doi.org/10.1177/1356389018819110.
Davier, A.V., Deonivic, B., Yudelson, M., Polyak, S.T., & Woo, A. (2019). Computational Psychometrics Approach to Holistic Learning and Assessment Systems. Front. Educ. 4:69. doi: 10.3389/feduc.2019.00069.
Dinh Do, T. & Thi dang, H. (2021). Factors Affecting Quality Culture: A Case Study of Public Universities in Ho Chi Minh City. Academy of Strategic Management Journal, 20, 1-11.
Ehsan, A., Klaas, H. S., Bastianen, A., & Spini, D. (2019). Social capital and health: a systematic review of systematic reviews. SSM Popul. Health 8:100425. doi: 10.1016/j.ssmph.2019.100425.
Fainshmidt, S., Wenger, L., Pezeshkan, A., & Mallon, M. (2019). When Do Dynamic Capabilities Lead to Competitive Advantage? The Importance of Strategic Fit (June 2019). Journal of Management Studies, 56(4), 758-787. Available at SSRN: https://ssrn.com/abstract=3378767.
Febrina, D. & Syamsir, S. (2020). The influence of integrity and commitment organizational on employee performance. International Journal of Research and Analytical Reviews (IJRAR), 7(1), 799-805.‏
Ficara, A., Curreri, F., Fiumara, G., & De Meo, P. (2023). Human and Social Capital Strategies for Mafia Network Disruption, in IEEE Transactions on Information Forensics and Security, 18, 1926-1936. doi: 10.1109/TIFS.2023.3256706.
Fuller, M. (2013). An Empirical Study of Cultures of Assessment in Higher Education. NCPEA Education Leadership Review, 14, 20-27.
Hanwright, J. & Makinson, S. (2008). Promoting evaluation culture: The development and implementation of an evaluation strategy in the Queensland Department of Education, Training and the Arts. Evaluation Journal of Australasia, 8(1), 20–25. https://doi.org/10.1177/1035719X0800800104.
Jacob, S., Speer, S., & Furubo, J.E. (2015). The institutionalization of evaluation matters: Updating the international atlas of evaluation 10 years later. Evaluation, 21(1), 6–31.
Janzen, R., Ochocka, J., Turner, L., Cook, T., Franklin, M., & Deichert, D. (2017). Building a community-based culture of evaluation. Evaluation and Program Planning, 65, 163-170.
Karabchuk, T. & Roshchina, Y. (2022). Predictors of student engagement: the role of universities’ or importance of students’ background?. European Journal of Higher Education, 3, https://doi.org/10.1080/21568235.2022.2035240.
Khaatami, S.M., Rajabeh-Farjad, H., & Chaharmahali, H. (2013). Evaluating the performance evaluation system of the organization's employees and presenting a proposed model; A case study. Scientific-Promotional Quarterly of Human Resources Studies, 3(11), 129-148. (in Persian)
Khadam-Mohtaram, K. & Salimi, M. (2018). Evaluation and quality assurance in the higher education system. Bimonthly Scientific-Specialist Journal of Applied Studies in Management and Development Sciences, 4(15), 47-34. (in Persian)
Malekpour, M., Azarbad, Z., & Pourebrahim Gilkalayeh, G. R. (2020). The Role of Organizational Culture in Evaluating the Performance of Human Resources in Organizations (Case Study: Tehran Region 5 Municipality). Geography and Human Relationships, 3(2), 461-477.
Malmir, M., Salehi, K., Moghadamzadeh, A., & Dehghani, M. (2021). Dimensions and Levels Of Quality Culture in the Higher Education System: A Systematic Review. Educational Measurement and Evaluation Studies, 11(36), 29-53. doi: 10.22034/emes.2021.251556. (in Persian)
Malmir, M., Salehi, K., Moghadamzadeh, A., & Dehghani, M. . (2023). Meaning and Concept of Quality Culture Based on The View of Stakeholders at Tehran University. Organizational Culture Management, 21. doi: 10.22059/jomc.2023.364285.1008585. (in Persian)
Mohammadzadeh, Z. & Salehi, K. (2015). Pathology of scientific vitality and dynamism in scientific and academic centers: A study according to “Phenomenology”. Quarterly Journal of The Macro and Strategic Policies, 3(Vol 3, No 11), 1-25. https://www.jmsp.ir/article_11013.html?lang=en. (in Persian)
Mohammadzadeh, Z. & Salehi, K. (2016). Explanation of the Phenomenon of Scientific Vitality and Dynamism in Scientific Centers from Perspective of Academic Elites: A Study According to "Phenomenology". Strategy, 25(2), 227-258. https://rahbord.csr.ir/article_124595.html?lang=en . (in Persian)
Mohammadzadeh, Z. & Salehi, K.  (2023). Using Grounded Theory to Explain the Process of formation of scientific vitality and dynamism in scientific and academic centers. Strategic Management Thought, 17(1). https://smt.isu.ac.ir/article_76755.html. (in Persian)
Njiro, E. (2012). Understanding Quality Culture in Assuring Learning at Higher Education Institutions. Journal of Educational Policy and Entrepreneurial Research (JEPER), 3(2), 79-92.
Nolzen, N. (2018). The concept of psychological capital: a comprehensive review. Manag. Rev. Q, 68, 237–277. doi: 10.1007/s11301-018-0138-6.
Owen, J. M. (2003). Evaluation culture: A definition and analysis of its development within organisations. Evaluation Journal of Australasia, 3(1), 43–47. https://doi.org/10.1177/1035719X0300300107.
Panadero, E., Fraile, J., Ruiz, F.J., Estevez, D.C., & Ruiz, M.A. (2019). Spanish university assessment practices: examination tradition with diversity by faculty. Journal Assessment & Evaluation in Higher Education, 44(3), 379-397.
Piascik, P. & Bird, E. (2008). Creating and sustaining a culture of assessment. American journal of pharmaceutical education, 72(5), 97. https://doi.org/10.5688/aj720597.
Rizva, B., Bikse, V., & Brence, L. (2015). Evaluation of Higher Education StudyProgrammes and their Development Trends as Drivers of Regional Growth. Procedia Economics and Finance, 26, 643-650.
Scheerens, J. (2004). The Evaluation Culture. Studies in Educational Evaluation, 30, 105-124.
Simper, N., Martensson, S., Berry, A., & Maynard, N. (2021). Assessment cultures in higher education: reducing barriers and enabling change. Assessment & Evaluation in Higher Education, 4. https://doi.org/10.1080/02602938.2021.1983770.
Stewart, S. (2013). Evaluating Culture. In: A Sociology of Culture, Taste and Value. Palgrave Macmillan. London. https://doi.org/10.1057/9781137377081_6.
Wahyuningsih, S. & Mubarok, M. (2021). The Effect of Integrity and Work Culture on Employee Performance in the Regional Financial Management Agency of Bekasi Regency. Eduvest-Journal of Universal Studies, 1(8), 693-700.‏
Widiarto, S. & Soerjanto, S. (2023). Increasing Student Satisfaction Through Improving Service Quality at Tourism Colleges in East Jakarta. Majalah Ilmiah Bijak, 20, 160, 172.
Xu, Q., Hou, Z., Zhang, C., Yu, F., Guan, J., & Liu, X. (2022) Human capital, social capital, psychological capital, and job performance: Based on fuzzy-set qualitative comparative analysis. Front. Psychol. 13:938875. doi: 10.3389/fpsyg.2022.938875.