Bibliometric indicators for the analysis of the research performance of a multidisciplinary institution: the CSIC
DOI:
https://doi.org/10.3989/redc.2012.1.851Keywords:
Bibliometric indicators, Spanish National Research Council (CSIC), research evaluation, scientific areas, institutional assessment, Web of Science (WoS)Abstract
An overview is provided of CSIC’s research performance in the context of Spain, through a study of its scholarly production in the Web of Science database, complemented with ICYT and ISOC, during the period 2004-2009. The eight scientific and technical areas in which CSIC’s centers are organised differ as to their national or international research orientation, their basic or applied nature, the degree of their collaboration and the size of their research teams; all of which influences each area’s publication and citation practices as well as its WoS-based productivity. The specific features of the different areas must be thoroughly understood in order to expound on and interpret properly the results of studies dealing with research evaluation.
Downloads
References
Abramo, G.; D-Angelo, C. A.; Di Costa, F. (2011). A national-scale cross-time analysis of university research performance. Scientometrics, vol. 87 (2), 399-413. http://dx.doi.org/10.1007/s11192-010-0319-0
Aksnes, D. W.; Sivertsen, G. (2009). A macro-study of scientific productivity and publication patterns across all scientific and scholarly disciplines. En: Larsen, B., Leta, J. (editores). Proceedings of ISSI, 12th International Conference on Scientometrics and Informetrics, pp. 394-397. Rio de Janeiro, Brasil.
Archambault, É.; Campbell, D.; Gingras, Y.; Larivière, V. (2009). Comparing bibliometric statistics obtained from the web of science and Scopus. Journal of the American Society for Information Science and Technology, vol. 60(7): 1320-1326. http://dx.doi.org/10.1002/asi.21062
Archambault, E.; Vignola-Gagne, E.; Coté, G.; Lariviere, V.; Gingras, Y. (2006). Benchmarking scientific output in the social sciences and humanitites : the limits of existing databases. Scientometrics, vol. 68 (3), 329-342. http://dx.doi.org/10.1007/s11192-006-0115-z
Bonaccorsi, A.; Daraio, C. (2003). A Robust Nonparametric Approach to the Analysis of Scientific Productivity. Research Evaluation, vol. 12 (1), 47-69. http://dx.doi.org/10.3152/147154403781776726
Bordons, M.; González-Albo, B. (2008). La investigación del CSIC a través de sus publicaciones científicas de difusión internacional (1981-2007). Madrid: IEDCYT, CCHS, CSIC.
Bordons, M.; Gómez, I. (2000). Collaboration Networks in Science. En: Cronin, B., Atkins, H. B. (editores). The Web of Knowledge. A Festschrift in Honor of Eugene Garfield. ASIS Monograph Series. Information Today, Inc. Medford, NJ, EE.UU.
Bordons, M.; Sancho, R.; Morillo, F.; Gómez, I. (2010). Perfil de actividad científica de las universidades españolas en cuatro áreas temáticas: un enfoque multifactorial. Revista Española de Documentación Científica, vol. 33 (1), 9-33. http://dx.doi.org/10.3989/redc.2010.1.718
Butler, L. (2003). Explaining Australia’s increased share of ISI publications. The effects of a funding formula based on publications counts. Research Policy, vol. 32 (1), 143-155. http://dx.doi.org/10.1016/S0048-7333(02)00007-0
Coccia, M. (2005). A scientometric model for the assessment of scientific research performance within public institutes. Scientometrics, vol. 65 (3), 307-321. http://dx.doi.org/10.1007/s11192-005-0276-1
Costas, R.; Van Leeuwen, T. N.; Bordons, M. (2010a). Self-Citations at the Meso and Individual Levels: Effects of Different Calculation Methods. Scientometrics, vol. 82 (3), 517-537. http://dx.doi.org/10.1007/s11192-010-0187-7 PMid:20234766 PMCid:2830585
Costas, R.; van Leeuwen, T. N.; Bordons, M. (2010b). A Bibliometric Classificatory Approach for the Study and Assessment of Research Performance at the Individual Level: the Effects of Age on Productivity and Impact. Journal of the American Society for Information Science and Technology, vol. 61(8), 1564-1581.
CSIC (2007). Memoria 2006 CSIC. Madrid: Consejo Superior de Investigaciones Científicas.
CSIC (2009). Plan Actuación Institucional del CSIC 2010-2013. Madrid: Consejo Superior de Investigaciones Científicas.
CSIC (2010). Memoria 2009 CSIC. Madrid: Consejo Superior de Investigaciones Científicas.
Debackere, K.; Glänzel, W. (2004). Using a bibliometric approach to support research policy making: the case of the Flemish BOF-key. Scientometrics, vol. 59 (2), 253-276. http://dx.doi.org/10.1023/B:SCIE.0000018532.70146.02
De Filippo, D.; Morillo, F.; Fernández, T. (2008). Indicadores de colaboración científica del CSIC con Latinoamérica en bases de datosinternacionales. Revista Española de Documentación Científica, vol. 31 (1), 66-84.
De Filippo, D.; Sanz-Casado, E.; Urbano, C.; Ardanuy, J.; Gómez, I. (2011). El papel de las bases de datos institucionales en el análisis de la actividad científica de las universidades. Revista Española de Documentación Científica, vol. 34 (2), 165-189. http://dx.doi.org/10.3989/redc.2011.2.797
Dundar, H.; Lewis, D. R. (1998). Determinants of research productivity in higher education. Research in Higher Education, vol. 39 (6), 607-631. Frame, J. D.; Carpenter, M. P. (1979). International Research Collaboration. Social Studies of Science, vol. 9 (4), 481-497.
Garfield, E. (2005). The agony and the ecstasy –the history and meaning of the journal impact factor. International Congresss on Peer Review and Biomedical Publication. Chicago, USA.
Gazni, A.; Didegah, F. (2011). Investigating different types of research collaboration and citation impact: a case study of Harvard University’s publications. Scientometrics vol. 87 (2): 251-265. http://dx.doi.org/10.1007/s11192-011-0343-8
Glanzel, W. (2002). Coauthorship patterns and trends in the sciences (1980-1998): A bibliometric study with implications for database indexing and search strategies. Library Trends vol. 50 (3), 461-473.
Gómez, I.; Bordons, M.; Morillo, F.; Moreno, L.; González-Albo, B. (2010). La actividad científica del CSIC a través del Web of Science. Estudio bibliométrico del periodo 2004- 2009. Madrid: IEDCYT, CCSH, CSIC. http://hdl.handle.net/10261/32097
Gómez, I.; Fernández, M. T.; Méndez, A. (1995). Collaboration patterns of Spanish publications in different research areas and disciplines. En: Koenig, M. E. D., Bookstein, A. (editores). Proceedings of the Fifth Biennial Conference of the International Society for Scientometrics and Informetrics, pp. 187-196. Medford: Learned Information. River Forest, USA.
Hicks, D. (1999). The difficulty of achieving full coverage of international Social Science literature and the bibliometric consequences. Scientometrics, vol. 44 (2), 193-216. http://dx.doi.org/10.1007/BF02457380
Hicks, D. (2004). The four literatures of Social Science. En: Moed, H., Glänzel, W., Smoch, U. (editores). Handbook of Quantitative Science and Technology Research. Kluwer Academic Publishers. Dordrecht, The Netherlands.
Jensen, P.; Rouquier, J. B.; Croissant, Y. (2009). Testing Bibliometric Indicators by Their Prediction of Scientists Promotions. Scientometrics, vol. 78 (3), 467-479. http://dx.doi.org/10.1007/s11192-007-2014-3
Jiménez-Contreras, E.; De-Moya-Anegón, F.; López-Cózar, E. D. (2003). The evolution of research activity in Spain: The impact of the National Commission for the Evaluation of Research Activity (CNEAI). Research Policy, vol. 32 (1), 123-142.
Journal Citation Reports (2006). Web of Science. Science Edition & Social Sciences Edition. http://portal.isiknowledge.com/
Katz, J. S.; Martin, B. R. (1997). What is research collaboration? Research Policy, vol. 26 (1), 1-18. http://dx.doi.org/10.1016/S0048-7333(96)00917-1
Larivière, V.; Gingras, Y.; Archambault, E. (2006). Canadian collaboration networks: a comparative analysis of the natural sciences, social sciences and the humanities. Scientometrics, vol. 68 (3), 519-533. http://dx.doi.org/10.1007/s11192-006-0127-8
Laredo, P.; Mustar, P. (2000). Laboratory activity profiles: an exploratory approach. Scientometrics, vol. 47 (3), 515-539. http://dx.doi.org/10.1023/A:1005671901143
Martin, B. R. (1996). The use of multiple indicators in the assessment of basic research. Scientometrics, vol. 36 (3), 343-362. http://dx.doi.org/10.1007/BF02129599
Mauleon, E.; Bordons, M.; Oppenheim, C. (2008). The Effect of Gender on Research Staff Success in Life Sciences in the Spanish National Research Council. Research Evaluation, vol. 17 (3), 213-225. http://dx.doi.org/10.3152/095820208X331676
Méndez, A.; Salvador, P. (1992). The application of scientometric indicators to the Spanish Scientific Research Council. Scientometrics, vol. 24 (1), 61-78. http://dx.doi.org/10.1007/BF02026473
Moed, H. F. (2005). Citation analysis in research evaluation. Springer, Dordrecht, The Netherlands.
Moya-Anegón, F. (dir) (2005). Indicadores bibliométricos de la actividad científica española 2004. Madrid: Fundación Española para la Ciencia y la Tecnología.
National Science Board (2010). Science and Engineering Indicators 2010. Arlington, VA: National Science Foundation (NSB 10-01).
Noma, E. (1986). Subject classification and infl uence weigths for 3000 journals. Cherry Hill, New Jersey: CHI Research/Computer Horizons, Inc.
Observatoire des Sciences et des Techniques (2010). Indicateurs de Sciences et de Technologies 2010. Paris: Ed. Economica & OST.
Rinia E. J.; van Leeuwen, T. N.; van Vuren, H. G.; van Raan, A. F. J. (1998). Comparative analysis of a set of bibliometric indicators and central peer review criteria - Evaluation of condensed matter physics in the Netherlands. Research Policy, vol. 27 (1), 95-107. http://dx.doi.org/10.1016/S0048-7333(98)00026-2
Romero de Pablos, A.; Azagra Caro, J. M. (2009). Internationalisation of patents by Public Research Organisations from a historical and an economic perspective. Scientometrics, vol. 79 (2), 329-340. http://dx.doi.org/10.1007/s11192-009-0421-3
Torres-Salinas, D.; Lopez-Cózar, E. D.; Jiménez-Contreras, E. (2009). Ranking of departments and researchers within a university using two different databases: Web of science versus Scopus Scientometrics, vol. 80 (3): 761-774.
Tuzi, F. (2005): Useful science is good science: Empirical evidence from the Italian National Research Council. Technovation, vol. 25 (5), 505-512.
Van Leeuwen, T. N.; Visser, M. S.; Moed, H. F.; Nederhof, T. J.; van Raan, A. F. J. (2003). Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence. Scientometrics, vol. 57 (2), 257-280. http://dx.doi.org/10.1023/A:1024141819302
Van Raan, A. F. J. (2004). Measuring science. En: Moed, H., Glänzel, W., Smoch, U. (editores). Handbook of Quantitative Science and Technology Research. Kluwer Academic Publishers. Dordrecht, The Netherlands
Van Raan, A. F. J. (1997). Science as an international enterprise. Science and Public Policy, vol. 24 (5), 290-300.
Wuchty, S.; Jones, B. F.; Uzzi, B. (2007). The increasing dominance of teams in production of knowledge. Science, vol. 316 (5827), 103. http://dx.doi.org/10.1126/science.1136099 PMid:17431139
Published
How to Cite
Issue
Section
License
Copyright (c) 2012 Consejo Superior de Investigaciones Científicas (CSIC)
This work is licensed under a Creative Commons Attribution 4.0 International License.
© CSIC. Manuscripts published in both the printed and online versions of this Journal are the property of Consejo Superior de Investigaciones Científicas, and quoting this source is a requirement for any partial or full reproduction.All contents of this electronic edition, except where otherwise noted, are distributed under a “Creative Commons Attribution 4.0 International” (CC BY 4.0) License. You may read here the basic information and the legal text of the license. The indication of the CC BY 4.0 License must be expressly stated in this way when necessary.
Self-archiving in repositories, personal webpages or similar, of any version other than the published by the Editor, is not allowed.
