Application of multimodal dialog systems and mobile devices to provide enhanced library services
DOI:
https://doi.org/10.3989/redc.2016.2.1262Keywords:
Dialog systems, multimodal interaction, automatic speech recognition and synthesis, automatic assistants, advanced library services, mobile devices, AndroidAbstract
In recent years smart mobile devices have bolstered new interaction scenarios that require more sophisticated human-machine interfaces. The leading developers of operating systems for these devices now provide APIs (Application Programming Interface) for developers to implement their own applications, including different solutions for developing graphical interfaces, control sensors and providing oral interaction. Despite the usefulness of these resources, defined strategies are still needed for developing multimodal interfaces to take greater advantage of these devices for identifying and meeting the needs of users. Currently, these applications are typically ad-hoc and facilitate oral communication only through simple commands. In this paper we propose the practical application of context-sensitive multimodal conversational agents to provide advanced library services that dynamically consider specific user needs and preferences, as well as the specific characteristics of the environment in which the interaction occurs. Such agents would improve and customize the service provided by a mobile device with Internet access. Our proposal integrates features of Android APIs on a modular architecture emphasizing the management of interactions and context awareness in order to create robust applications that can be easily updated and adapted to the user.
Downloads
References
Balagué, N.; Düren, P.; Juntunen, A.; Saarti, J. (2014). Quality Audits as a Tool for Quality Improvement in Selected European Higher Education Libraries. The Journal of Academic Librarianship, vol. 40 (5), 529-533. http://dx.doi.org/10.1016/j.acalib.2014.01.002
Becker, R.; Cáceres, R.; Hanson, K.; Isaacman, S., Loh, J., Martonosi, M., Rowland, J., Urbanek, S.; Varshavsky, A.; Volinsky, C. (2013). Human mobility characterization from cellular network data. Communications of the ACM, vol. 56(1), 74– 82. http://dx.doi.org/10.1145/2398356.2398375
Calhoun, K. (2002). From information gateway to digital library management system: a case analysis. Library Collections, Acquisitions, and Technical Services, vol. 26(2), 141-150. http://dx.doi.org/10.1016/S1464-9055(02)00226-9
Calhoun, K.; Cellentani, D. (2009). Online catalogers: What users and librarians want. OCLC report. Dublin, OH: OCLC.
Casey, M.E.; Savastinuk, L.C. (2007). Library 2.0. A Guide to Participatory Library Service, Information Today.
Casta-o, B.; E-Martín, Y.; R-Moreno, M.D.; Usero, L. (2013). Sistema Inteligente de Detección y Orientación de usuarios en Bibliotecas. Revista Española de Documentación Científica, 36(1):en003.
Chen, H.L.; Albee, B. (2012). An open source library system and public library users: Finding and using library collections. Library & Information Science Research, vol. 34(3), 220-227. http://dx.doi.org/10.1016/j.lisr.2011.12.001
Chen, C.M.; Tsai, Y.N. (2012). Interactive augmented reality system for enhancing library instruction in elementary schools. Computers & Education, vol. 59(2), 638-652. http://dx.doi.org/10.1016/j.compedu.2012.03.001
Díaz-Valenzuela, I.; Martín-Bautista, M.J.; Vila, M.A.; Campaña, J.R. (2013). An automatic system for identifying authorities in digital libraries. Expert Systems with Applications, vol. 40 (10), 3994-4002. http://dx.doi.org/10.1016/j.eswa.2013.01.010
Dwivedi, Y.K.; Kapoor, K.K.; Williams, M.D.; Williams, J. (2013). RFID systems in libraries: An empirical examination of factors affecting system use and user satisfaction. International Journal of Information Management, vol. 33(2), 367-377. http://dx.doi.org/10.1016/j.ijinfomgt.2012.10.008
Evergreen. (2010). Evergreen Indiana: Resource & sharing cooperative of Evergreen libraries. Disponible en: http://rscel.evergreen-ils.org/ node/1457
Fagan, J.C. (2014). The Suitability of Web Analytics Key Performance Indicators in the Academic Library Environment. The Journal of Academic Librarianship, vol. 40(1), 25-34. http://dx.doi.org/10.1016/j.acalib.2013.06.005
González-Fernández-Villavicencio, N.; Cánovas-Álvarez, E.; Arahal-Junco, C. (2014). Evaluación del servicio de referencia de una biblioteca universitaria: Biblioteca de la Universidad de Sevilla. Revista Española de Documentación Científica, 37(2):e045. http://dx.doi.org/10.3989/redc.2014.2.1072
Griol, D.; Callejas, Z.; López-Cózar, R.; Riccardi, G. (2014). A domain-independent statistical methodology for dialog management in spoken dialog systems. Computer Speech and Language, vol. 28(3), 743–768. http://dx.doi.org/10.1016/j.csl.2013.09.002
Griol, D.; Carbó, J.; Molina, J. (2013). An Automatic Dialog Simulation Technique to Develop and Evaluate Interactive Conversational Agents. Applied Artificial Intelligence, vol. 27(9), 759–780. http://dx.doi.org/10.1080/08839514.2013.835230
Helling, J. (2010). A case study of one library's decision to migrate to an open source ILS. Library Review, vol. 59(9), 707-707.
Kaufmann, T.; Pfister, B. (2012). Syntactic language modeling with formal grammars. Speech Communication, vol. 54(6), 715–731. http://dx.doi.org/10.1016/j.specom.2012.01.001
Larson, J.A. (2002). VoiceXML Introduction to Developing Speech Applications. Prentice Hall.
Lemon, O. (2011). Learning what to say and how to say it: Joint optimisation of spoken dialogue management and natural language generation. Computer Speech & Language, vol. 25(2), 210– 221. http://dx.doi.org/10.1016/j.csl.2010.04.005
Liu, Z. (2006) Print vs. electronic resources: a study of user perceptions, preferences, and use. Information Processing and Management, vol. 42(2), 583–592. http://dx.doi.org/10.1016/j.ipm.2004.12.002
Mann, T. (2008). On the record but off the track: A review of the report of the Library of Congress Working Group on Bibliographic Control, with a further examination of Library of Congress cataloging tendencies. Disponible en: http://www. guild2910.org/WorkingGrpResponse2008.pdf
McTear, M., Callejas, Z. (2013). Voice Application Development for Android. Packt Publishing.
Metze, F.; Wechsung, I.; Schaffer, S.; Seebode, J.; Möller, S. (2009). Human-Computer Interaction. Novel Interaction Methods and Techniques, Springer-Verlag, cap. Reliable Evaluation of Multimodal Dialogue Systems, pp 75–83. http://dx.doi.org/10.1007/978-3-642-02577-8_9
Moreno, M.D.; Casta-o, B.; Barrero, D.F.; Hellín, A.M. (2014). Efficient Services Management in Libraries using AI and Wireless techniques. Expert Systems with Applications, vol. 41(17), 7904-7913. http://dx.doi.org/10.1016/j.eswa.2014.06.047
O'Reilly, T. (2005). What is Web 2.0. Design Patterns and Business Models for the Next Generation of Software.
Ordu-a-Malea, E. (2013). Espacio universitario español en la Web (2010): estudio descriptivo de instituciones y productos académicos a través del análisis de subdominios y subdirectorios. Revista Española de Documentación Científica, 36(3):e017.
Paek, T.; Pieraccini, R. (2008). Automating spoken dialogue management design using machine learning: An industry perspective. Speech Communication, vol. 50(8–9), 716-729. http://dx.doi.org/10.1016/j.specom.2008.03.010
Park, N.; Roman, R.; Lee, S.; Chung, J.E. (2009). User acceptance of a digital library system in developing countries: An application of the Technology Acceptance Model. International Journal of Information Management, vol. 29(3), 196-209. http://dx.doi.org/10.1016/j.ijinfomgt.2008.07.001
Pérez-Marín, D.; Pascual-Nieto, I. (2011). Conversational Agents and Natural Language Interaction: Techniques and Effective Practices. IGI Global. http://dx.doi.org/10.4018/978-1-60960-617-6
Pieraccini, R. (2012). The Voice in the Machine: Building Computers that Understand Speech. MIT Press.
Porcel, C.; Herrera-Viedma, E. (2010). Dealing with incomplete information in a fuzzy linguistic recommender system to disseminate information in university digital libraries. Knowledge-Based Systems, vol. 23(1), 32-39. http://dx.doi.org/10.1016/j.knosys.2009.07.007
Porcel, C.; Moreno, J.M.; Herrera-Viedma, E. (2009). A multi-disciplinar recommender system to advice research resources in University Digital Libraries. Expert Systems with Applications, vol. 36(10), 12520-12528. http://dx.doi.org/10.1016/j.eswa.2009.04.038
Renda, M.E.; Straccia, U. (2005). A personalized collaborative digital library environment: a model and an application, Information Processing and Management, vol. 41(1), 5-21. http://dx.doi.org/10.1016/j.ipm.2004.04.007
Ross, L.; Sennyey P. (2008). The library is dead, long live the library! the practice of academic librarianship and the digital revolution. The Journal of Academic Librarianship, vol. 34 (2), 145–152. http://dx.doi.org/10.1016/j.acalib.2007.12.006
Sanz-Santacruz, V.; Serrano-Vicente, R.; Iturbide- Tellechea, M.A. (2013). La estancia en bibliotecas extranjeras como instrumento de formación bibliotecaria: la experiencia de la Universidad de Navarra (2003-2010). Revista Española de Documentación Científica, 36(1):en001.
Schatzmann, J.; Weilhammer, K.; Stuttle, M.; Young, S. (2006). A Survey of Statistical User Simulation Techniques for Reinforcement-Learning of Dialogue Management Strategies. Knowledge Engineering Review, vol. 21(2), 97-126. http://dx.doi.org/10.1017/S0269888906000944
Seneff, S.; Adler, M.; Glass, J.; Sherry, B.; Hazen, T.; Wang, C.; Wu, T. (2007). Exploiting Context Information in Spoken Dialogue Interaction with Mobile Devices. In: Proc. IMUx'07, pp 1–11
Serrano-Guerrero, J.; Herrera-Viedma, E.; Olivas, J.A.; Cerezo, A.; Romero, F.P. (2011). A Google wave-based fuzzy recommender system to disseminate information in University Digital Libraries 2.0. Information Sciences, vol. 181 (9), 1503-1516. http://dx.doi.org/10.1016/j.ins.2011.01.012
Shatte, A.; Holdsworth, J.; Lee, I. (2014). Mobile augmented reality based context-aware library management system. Expert Systems with Applications, vol. 41(5), 2174-2185. http://dx.doi.org/10.1016/j.eswa.2013.09.016
Smeaton, A.F.; Callan, J. (2005). Personalisation and recommender systems in digital libraries. International Journal on Digital Libraries, vol. 5(4), 299-308. http://dx.doi.org/10.1007/s00799-004-0100-1
Tejeda-Lorente, A.; Porcel, C.; Peis, E.; Sanz, R.; Herrera-Viedma, E. (2014). A quality based recommender system to disseminate information in a university digital library. Information Sciences, vol. 261, 52-69. http://dx.doi.org/10.1016/j.ins.2013.10.036
Tsuji, K.; Takizawa, N.; Sato, S.; Ikeuchi, U.; Ikeuchi, A.; Yoshikane, F.; Itsumura, H. (2014). Book Recommendation Based on Library Loan Records and Bibliographic Information. Procedia - Social and Behavioral Sciences, vol. 147, 478-486. http://dx.doi.org/10.1016/j.sbspro.2014.07.142
Vassilakaki, E.; Garoufallou, E. (2013). Multilingual Digital Libraries: A review of issues in system-centered and user-centered studies, information retrieval and user behavior. The International Information & Library Review, vol. 45(1–2), 3-19. http://dx.doi.org/10.1080/10572317.2013.10766367
Wu, W.L.; Lu, R.Z.; Duan, J.Y.; Liu, H.; Gao, F.; Chen, Y.Q. (2010). Spoken language understanding using weakly supervised learning. Computer Speech & Language, vol. 24(2), 358–382. http://dx.doi.org/10.1016/j.csl.2009.05.002
Published
How to Cite
Issue
Section
License
Copyright (c) 2016 Consejo Superior de Investigaciones Científicas (CSIC)
This work is licensed under a Creative Commons Attribution 4.0 International License.
© CSIC. Manuscripts published in both the print and online versions of this journal are the property of the Consejo Superior de Investigaciones Científicas, and quoting this source is a requirement for any partial or full reproduction.
All contents of this electronic edition, except where otherwise noted, are distributed under a Creative Commons Attribution 4.0 International (CC BY 4.0) licence. You may read the basic information and the legal text of the licence. The indication of the CC BY 4.0 licence must be expressly stated in this way when necessary.
Self-archiving in repositories, personal webpages or similar, of any version other than the final version of the work produced by the publisher, is not allowed.
