Sensitivity and elasticity of Spanish universities to the Shanghai Ranking indicators (ARWU)
DOI:
https://doi.org/10.3989/redc.2023.1.1947Keywords:
sensitivity and elasticity to ARWU indicators, Shanghai ranking, university rankings, cluster of Spanish universitiesAbstract
The Shanghai ranking (ARWU) is one of the best known and most influential, good proof is its presence in traditional and digital media when it is published every year. Due to its characteristics, it is one of the most used and referenced in university management. This work analyzes the sensitivity and elasticity of the indicators that comprise it, distinguishing between indicators of a personal and institutional nature. The analysis focuses on the Spanish universities among the thousand collected in 2021, showing those that are more and less sensitive and elastic to the different indicators, both in position and in score. In addition, five homogeneous groups of universities are identified based on their elasticity. This shows the great heterogeneity of the changes due to the elimination of each indicator and type of university. This is useful for benchmarking between universities and identifying improvement actions to manage presence in the ranking.
Downloads
References
Altbach, P. G., y Salmi, J. (eds.). (2011). The road to academic excellence: The making of world-class research universities. The World Bank. https://doi.org/10.1596/978-0-8213-8805-1
Cantwell, B., y Taylor, B. J. (2013). Global status, intra-institutional stratification and organizational segmentation: A time-dynamic tobit analysis of ARWU position among US universities. Minerva, 51(2), 195-223. https://doi.org/10.1007/s11024-013-9228-8
Dobrota, M., y Dobrota, M. (2016). ARWU ranking uncertainty and sensitivity: What if the award factor was excluded?. Journal of the Association for Information Science and Technology, 67(2), 480-482. https://doi.org/10.1002/asi.23527
Delgado López-Cózar, E. (2012). Cómo se cocinan los rankings universitarios. Dendra Médica. Revista de Humanidades, 11 (1), 43-58.
Diem, A., y Wolter, S. C. (2013). The use of bibliometrics to measure research performance in education sciences. Research in higher education, 54(1), 86-114. https://doi.org/10.1007/s11162-012-9264-5
Docampo, D. (2013). Reproducibility of the Shanghai academic ranking of world universities results. Scientometrics, 94(2), 567-587. https://doi.org/10.1007/s11192-012-0801-y
Docampo, D. (2010). On using the Shanghai ranking to assess the investigation performance of university systems. Scientometrics, 86 (1), 77-92. https://doi.org/10.1007/s11192-010-0280-y
Docampo, D., Luque-Martínez, T., Torres-Salinas, D., y Herrera, F. (2012). Efecto de la agregación de universidades españolas en el Ranking de Shanghai (ARWU): caso de las comunidades autónomas y los campus de excelencia. El profesional de la información, 21(4), 428-432. https://doi.org/10.3145/epi.2012.jul.16
Dowsett, L. (2020). Global university rankings and strategic planning: a case study of Australian institutional performance. Journal of Higher Education Policy and Management, 42(4), 478-494. https://doi.org/10.1080/1360080X.2019.1701853
Florian,R.V. (2007). Irreproducibility of the results of the Shanghai academic ranking of world universities. Scientometrics, 72(1), 25-32. Springer;Akadémiai Kiadó. https://doi.org/10.1007/s11192-007-1712-1
González-Riaño, M. G., Repiso, R., y Delgado López-Cózar, E. (2014). Repercusión de los rankings universitarios en la prensa española. Revista Española de Documentación Científica, 37(3): e055. https://doi.org/10.3989/redc.2014.3.1128
Hazelkorn, E. (2011). Rankings and the reshaping of higher education. The battle for world-class excellence. Londres: Palgrave Mcmillan. https://doi.org/10.1057/9780230306394
Hazelkorn, E. (2012). The Effects of Rankings on Student Choices and Institutional Selection. En Jongbloed, B., y Vossensteyn, H. (eds.), Access and Expansion Post- Massification: Opportunities and Barriers to Further Growth in Higher Education Participation. London: Routledge.
Hazelkorn, E. (2018). Reshaping the world order of higher education: the role and impact of rankings on national and global systems. Policy Reviews in Higher Education, 2(1), 4-31. https://doi.org/10.1080/23322969.2018.1424562
Hou, A. Y. C., Morse, R., y Chiang, C. L. (2012). An analysis of mobility in global rankings: making institutional strategic plans and positioning for building world-class universities. Higher Education Research y Development, 31(6), 841-857. https://doi.org/10.1080/07294360.2012.662631
Jajo, N. K., y Harrison, J. (2014). World university ranking systems: An alternative approach using partial least squares path modelling. Journal of Higher Education Policy and Management, 36(5), 471-482. https://doi.org/10.1080/1360080X.2014.936090
Jovanovic, M., Jeremic, V., Savic, G., Bulajic, M., y Martic, M. (2012). How does the normalization of data affect the ARWU ranking?. Scientometrics, 93(2), 319-327. https://doi.org/10.1007/s11192-012-0674-0
Luque-Martínez, T. (2012). Técnicas de análisis de datos para la investigación de mercados. Madrid: Pirámide.
Luque-Martínez, T. (2015). Horizon 2031. The University of Granada in Light of its V Century. Reflections on the Future of the University. Granada: Editorial Universidad de Granada. Disponible en: http://biotic.ugr.es/pages/horizon-2031 .
Luque-Martínez, T., y Barrio-García, S. del (2016). Constructing a synthetic indicator of research activity. Scientometrics, 108 (3), 1049-1064. https://doi.org/10.1007/s11192-016-2037-8
Luque-Martínez, T., Doña, L., y Docampo, D. (2016). Influencia del programa Campus de Excelencia Internacional en la posición de las universidades españolas en el ranking de Shanghái. Revista Española de Documentación Científica, 39(3): e143. https://doi.org/10.3989/redc.2016.3.1339
Luque-Martínez, T., Faraoni, N., y Doña-Toledo, L. (2018). Meta-ranking de universidades. Posicionamiento de las universidades españolas. Revista Española de Documentación Científica, 41 (1): e198. https://doi.org/10.3989/redc.2018.1.1456
Pandiella-Dominique, A., Moreno-Lorente, L., García-Zorita, C., y Sanz-Casado, E. (2018). Model for estimating Academic Ranking of World Universities (Shanghai Ranking) scores. Revista Española de Documentación Científica, 41(2): e204. https://doi.org/10.3989/redc.2018.2.1462
Robinson-García, N., Rodríguez-Sánchez, R., García, J. A., Torres-Salinas, D., y Fdez-Valdivia, J. (2013). Análisis de redes de las universidades españolas de acuerdo a su perfil de publicación en revistas por áreas científicas. Revista Española de Documentación Científica, 36 (4): e027, https://doi.org/10.3989/redc.2013.4.1042
Safón, V. (2019). Inter-ranking reputational effects: an analysis of the Academic Ranking of World Universities (ARWU) and the Times Higher Education World University Rankings (THE) reputational relationship. Scientometrics, 121(2), 897-915. https://doi.org/10.1007/s11192-019-03214-9
Sanz-Casado, E., García-Zorita, C., Serrano-López, A. E., Efraín-García, P., y De Filippo, D. (2013). Rankings nacionales elaborados a partir de múltiples indicadores frente a los de índices sintéticos. Revista Española de Documentación Científica, 36(3): e012. https://doi.org/10.3989/redc.2013.3.1.023
Soh, K. (2015). What the Overall doesn't tell about world university rankings: examples from ARWU, QSWUR, and THEWUR in 2013. Journal of Higher Education Policy and Management, 37(3), 295-307. https://doi.org/10.1080/1360080X.2015.1035523
Véliz, D., y Marshall, P. (2021) Influence of global rankings on strategic planning from the perspective of decision-makers: A case study of a Chilean research university. Higher Education Quarterly. https://doi.org/10.1111/hequ.12333
Wu, Y., y Liu, N. C. (2017). Academic ranking of world universities (ARWU): Methodologies and trends. In Research Analytics, 95-120. Auerbach Publications. https://doi.org/10.1201/9781315155890-6
Zacharewicz, T., Jonkers, K., y Hazelkorn, E. (2021). Are global rankings compatible with higher education policy? In Research Handbook on University Rankings. Edward Elgar Publishing.
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Consejo Superior de Investigaciones Científicas (CSIC)
This work is licensed under a Creative Commons Attribution 4.0 International License.
© CSIC. Manuscripts published in both the printed and online versions of this Journal are the property of Consejo Superior de Investigaciones Científicas, and quoting this source is a requirement for any partial or full reproduction.All contents of this electronic edition, except where otherwise noted, are distributed under a “Creative Commons Attribution 4.0 International” (CC BY 4.0) License. You may read here the basic information and the legal text of the license. The indication of the CC BY 4.0 License must be expressly stated in this way when necessary.
Self-archiving in repositories, personal webpages or similar, of any version other than the published by the Editor, is not allowed.
Funding data
Consejería de Conocimiento, Investigación y Universidad, Junta de Andalucía,Consejería de Transformación Económica, Industria, Conocimiento y Universidades
Grant numbers P20-02019
European Regional Development Fund
Grant numbers P20-02019
