Construction of a quality verification tool for Internet-based scientific research portals and networks
DOI:
https://doi.org/10.3989/redc.2012.4.900Keywords:
Assessment, quality, indicators, web, scientific portals, social sciences, health sciences, verification tool, researchAbstract
This study proposes a verification tool, validated by experts, for detecting the presence of quality indicators in scientific portals and websites related to Social and Health Sciences. Three studies were carried out using a non-experimental mixed design: document analysis and qualitative and quantitative assessments performed by referees. The result was the development of the QuaSciWeb tool which contains 57 items spread over 6 categories of analysis: 1) Identity and authorship; 2) User interface; 3) Contents; 4) Surfing and data recovery; 5) User experience; 6) Visibility and dissemination. The tool permits a) the assessment of the quality of scientific portals and websites, b) the identification of the contents needed for improvement and c) concrete guidelines which can be used by programmers and web designers.
Downloads
References
Aguillo, I. F., Granadino, B., Ortega, J. L.; Prieto, J. A. (2006): Scientific research activity and communication measured with cybermetrics indicators. Journal of the American Society for Information Science and Technology, vol. 57 (10), 1296-1302. http://dx.doi.org/10.1002/asi.20433
Alexa Internet (2011): The web information company. http://www.alexa.com [consultado el 26 de julio de 2011].
Almind, T. C.; Ingwersen, P. (1997): Informetric analyses on the world wide web: Methodological approaches to «webometrics». Journal of Documentation, vol. 53 (4), 404-426. http://dx.doi.org/10.1108/EUM0000000007205
Alonso Berrocal, J. L.; García Figuerola, C.; Zazo, Á. F. (2008): Recuperación de información web: 10 an.os de cibermetri´a. Ibersid: revista de sistemas de información y documentación, vol. 2, 69-78.
Arakaki, M.; Willett, P. (2009): Webometric analysis of departments of librarianship and information science: A follow-up study. Journal of Information Science, vol. 35 (2), 143-142. http://dx.doi.org/10.1177/0165551508094051
Arroyo, N.; Ortega, J. L.; Pareja, V.; Prieto, J. A.; Aguillo, I. (2005): Cibermetría. Estado de la cuestión. Actas de las IX Jornadas Españolas de Documentación FESABID. Madrid, España: FESABID. http://digital.csic.es/bitstream/10261/4296/1/R-17.pdf [consultado el 26 de julio de 2011].
Barjak, F.; Thelwall, M. (2008): A statistical analysis of the web presences of European life sciences research teams. Journal of the American Society for Information Science and Technology, vol. 59 (4), 628-643. http://dx.doi.org/10.1002/asi.20776
Barnes, S. J.; Vidgen, R. T. (2002): An integrative approach to the assessment of e-commerce quality. Journal of Electronic Commerce Research, vol. 3 (3), 114-127.
Batlle-Montserrat, J.; Abadal, E.; Blat, J. (2011): Benchmarking del e-gobierno local: Limitaciones de los métodos de evaluación comparativa. El Profesional de la Información, vol. 20 (3), 251-259. http://dx.doi.org/10.3145/epi.2011.may.02
Björneborn, L.; Ingwersen, P. (2001): Perspective of webometrics. Scientometrics, vol. 50 (1), 65-82. http://dx.doi.org/10.1023/A:1005642218907
Björneborn, L.; Ingwersen, P. (2004): Toward a basic framework for webometrics. Journal of the American Society for Information Science and Technology, vol. 55 (14), 1216-1227. http://dx.doi.org/10.1002/asi.20077
Caraballo-Pérez, Y.; Torres-Cárdenas, V.; Noda-Amoros, A.-C.;Herrera-Toscano, J. A. (2008): Medidas de popularidad de la educación superior cubana: Un análisis webmétrico. El Profesional de la Información, vol. 17 (4), 44-448. http://dx.doi.org/10.3145/epi.2008.jul.12
Chao, H. Y. (2002): Assessing the quality of academic libraries on the Web: The development and testing of criteria. Library & Information Science Research, vol. 24 (2), 169-194. http://dx.doi.org/10.1016/S0740-8188(02)00111-1
Choudrie, J.; Ghinea, G.; Weerakkody, V. (2004): Evaluating global e-government sites: A view using web diagnostic tools. Electronic Journal of e-Government, vol. 2 (2), 105-114.
Codina, L.;Marcos, M. C. (2005): Posicionamiento web: conceptos y herramientas. El Profesional de la Información, vol. 14 (2), 84-99. http://dx.doi.org/10.3145/epi.2005.mar.01
Cohen, R. J.;Swerdlik, M. E. (2006): Pruebas y evaluación psicológicas. Introducción a las pruebas y a la medición. México D.F.; McGraw-Hill, 807 p.
DeVon, H. A.; Block, M. E.; Oyle-Wright, P.; Ernst, D. M.; Hayden, S. J.; Lazzara, D. J.; Savoy, S. M.; Kostas-Polston, E. (2007): A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship, vol. 39 (2), 155-164. http://dx.doi.org/10.1111/j.1547-5069.2007.00161.x PMid:17535316
Diniz, E.; Morena Porto, R.; Adachi, T. (2005): Internet banking in Brazil: Evaluation of functionality, reliability and usability. The Electronic Journal Information Systems Evaluation, vol. 8 (1), 41-50.
González-Lucio, J. A.; Faba-Pérez, C.; de Moya Anegón, F.; Moscoso-Castro, P. (2009): Evolution of the formal quality indicators of the Web spaces of University Libraries in Spain. Cybermetrics, vol. 13 (1), paper 1.
Hasan, L.; Abuelrub, E. (2011): Assessing the quality of web sites. Applied Computing and Informatics, vol. 9 (1), 11-29. http://dx.doi.org/10.1016/j.aci.2009.03.001
Hussin, H.; Suhaimi, M. A.; Mustafa, M. (2005): E-Commerce and ethical web design: Applying the BBBOnline guidelines on Malaysian web sites. The International Arab Journal of Information Technology, vol. 2 (3), 219-227.
Ingwersen, P. (1998): The calculation of Web impact factors. Journal of Documentation, vol. 54 (2), 236-243. http://dx.doi.org/10.1108/EUM0000000007167
Lautenbach, M. A. E.; Schegget, I. S.; Schoute, A. M.; Witteman, C. L. M. (2006): Evaluating the usability of web pages: A case study: Utrecht University. http://www.phil.uu.nl/preprints/ckipreprints/PREPRINTS/preprint011.pdf [consultado el 26 de julio de 2011].
Lynn, M. R. (1986): Determination and quantification of content validity. Nursing Research, vol. 35, 382-385. http://dx.doi.org/10.1097/00006199-198611000-00017 PMid:3640358
Marcos, M. C. (2006): Webometrics pone orden en las universidades. El Profesional de la Información, vol. 15 (3), 231-236. http://dx.doi.org/10.3145/epi.2006.may.12
Maynard, M.; Tian, Y. (2004): Between global and glocal: content analysis of the Chinese Web Sites of the 100 top global brands. Public Relations Review, vol. 30 (3), 285-291. http://dx.doi.org/10.1016/j.pubrev.2004.04.003
Mebrate, T. W. (2010): A framework for evaluating academic website quality from students' perspective. Tesis de Master no publicada. Delft University of Technology. PMCid:2755997
Millman, J.; Greene, J. (1989): The specification and development of test of achievement and ability. En: Linn, R. (editor) Educational Measurement. Macmillan, London, UK.
Miranda, F. J.; Cortés, R.; Barriuso, C. (2006): Quantitative evaluation of e-banking web sites: An empirical study of Spanish banks. The Electronic Journal Information Systems Evaluation, vol. 9 (2), 73-82.
Monaghan, B. (2008): The limitations of eGovernment evaluation: A critical review. iSCHANNEL, vol. 3 (1), 16-19.
Muñiz, José; Fidalgo, A.M.; Cueto, E.G.; Martínez, R.; Moreno, R. (2005): Análisis de los ítems. Madrid: La Muralla, p. 181.
Olsina, L.; Rossi, G. (2002): Measuring Web application quality with WebQEM. Ieee Multimedia, vol. 9 (4), 20-29. http://dx.doi.org/10.1109/MMUL.2002.1041945
Ortega, J. L.; Aguillo, I. (2006): Ana’lisis de co-enlaces: una aproximacio’n teo’rica. El Profesional de la Información, vol. 15 (4), 270-277. http://dx.doi.org/10.3145/epi.2006.jul.04
Ortega, J. L.; Aguillo, I. (2007): La web acade’mica espan.ola en el contexto del Espacio Europeo de Educacio’n Superior: Estudio exploratorio. El Profesional de la Información, vol. 16 (5), 417-425. http://dx.doi.org/10.3145/epi.2007.sep.03
Ortega, J. L.; Aguillo, I. (2009): Análisis estructural de la web académica iberoamericana. Revista Española de Documentación Científica, 32 (3), 51-65. http://dx.doi.org/10.3989/redc.2009.3.689
Ortega, J. L.; Aguillo, I.; Prieto, J. A. (2006): Longitudinal study of contents and elements in the scientific web environment. Journal of Information Science, vol. 32 (4), 344-351. http://dx.doi.org/10.1177/0165551506065785
Page, L.; Brin, S.; Motwani, R.; Winograd, T. (1998): The PageRank citation ranking: Bringing order to the web. Technical report: Stanford Digital Library Technologies Project.
Palatano, M. (2002): Ana’lisis de los sitios web de las bibliotecas universitarias argentinas. El Profesional de la Información, vol. 11 (2), 102-110. http://dx.doi.org/10.1076/epri.11.2.102.13717
Pinto, M.; Alonso Berrocal, J. L.; Cordón García, J. A.; Fernández Marcial, V.; García Figuerola, C.; García Marco, J. (2005): Quality assessment of Spanish universities' Web sites focused on the European Research Area. Scientometrics, vol. 65 (1), 67-93. http://dx.doi.org/10.1007/s11192-005-0260-9
Pinto, M.; Alonso Berrocal, J. L.; Cordón García, J. A.; Fernández Marcial, V.; García Figuerola, C.; García Marco, J. (2004): Análisis cualitativo de la visibilidad de la investigación de las universidades españolas a través de sus páginas web. Revista Española de Documentación Científica, vol. 27 (3), 345-370.
Pinto, M.; Guerrero, D.; Fernandez-Ramos, A.; Doucet, A. V. (2009): Information provided by Spanish university websites on their assessment and quality processes. Scientometrics, vol. 81 (1), 265-289. http://dx.doi.org/10.1007/s11192-008-2123-7
Raman, M.; Stephenaus, R.; Alam, N.; Kuppusamy, M. (2008): Information technology in Malaysia: E-service quality and uptake of internet banking. Journal of Internet Banking and Commerce, vol. 13 (2).
Ribera, M.; Térmens, M.; Frías, A. (2009): La accessibilidad de las webs de las universidades españolas. Balance 2001-2006. Revista Española de Documentación Científica, vol. 32 (3), 66-88. http://dx.doi.org/10.3989/redc.2009.3.683
Rousseau, R. (1997): Sitations: An exploratory study. Cybermetrics, vol. 1 (1), paper 1.
Rovira, C. F.; Marcos, M. C.; Codina, L. (2007): Repositorios de publicaciones digitales de libre acceso en Europa: Ana’lisis y valoracio’n de la accesibilidad, posicionamiento web y calidad del co’digo. El Profesional de la Información, vol. 16 (1), 24-38. http://dx.doi.org/10.3145/epi.2007.jan.03
Smith, A. G. (1999): The impact of web sites: A comparison between Australasia and Latin America. Actas del Congreso Internacional de Información, INFO'99. La Habana, Cuba. http:/www.vuw.ac.nz/staff/alastair_smith/publns/austlat [consultado el 26 de julio de 2011].
Thelwall, M. (2008): Bibliometrics to webometrics. Journal of Information Science, vol. 34 (4), 605-621. http://dx.doi.org/10.1177/0165551507087238
Thelwall, M.; Harries, G. (2003): The connection between the research of a university and counts of links to its web pages: An investigation based upon a classification of the relationships of pages to the research of the host university. Journal of the American Society for Information Science and Technology, vol. 54 (7), 594-602. http://dx.doi.org/10.1002/asi.10161
Thelwall, M.; Sud, P. (2011): A comparison of methods for collecting web citation data for academic organizations. Journal of the American Society for Information Science and Technology, vol. 62 (8), 1488-1497. http://dx.doi.org/10.1002/asi.21571
Thelwall, M.; Vaugan, L.; Björneborn, L. (2005): Webometrics. Annual Review of Information Science and Technology, vol. 35, 81-135.
Thomas, O.; Willett, P. (2000): Webometric analysis of departments of librarianship and information science. Journal of Information Science, vol. 26 (6), 421-428. http://dx.doi.org/10.1177/016555150002600605
Wyman, S. K.; Beachboard, J. C.; McClure, C. R. (1997): User and system-based quality criteria for evaluating information resources and services available from federal websites: Final report: Syracuse University. http://eric.ed.gov/ERICWebPortal/search/detailmini.jsp?_nfpb=true&_&ERICExtSearch_SearchValue_0=ED409020&ERICExtSearch_SearchType_0=no&accno=ED409020 [consultado el 26 de julio de 2011].
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2012 Consejo Superior de Investigaciones Científicas (CSIC)
This work is licensed under a Creative Commons Attribution 4.0 International License.
© CSIC. Manuscripts published in both the printed and online versions of this Journal are the property of Consejo Superior de Investigaciones Científicas, and quoting this source is a requirement for any partial or full reproduction.All contents of this electronic edition, except where otherwise noted, are distributed under a “Creative Commons Attribution 4.0 International” (CC BY 4.0) License. You may read here the basic information and the legal text of the license. The indication of the CC BY 4.0 License must be expressly stated in this way when necessary.
Self-archiving in repositories, personal webpages or similar, of any version other than the published by the Editor, is not allowed.
