Towards the Use of Social Robot Furhat and Generative AI in Testing Cognitive Abilities
-
Róbert Sabo
, Štefan Beňuš
, Viktória Kevická
Abstract
Spoken communication between social robotic devices, powered by generative AI tools such as ChatGPT, and the senior population offers great potential for researching social interaction and robot identity perceptions as well as exploring the potential opportunities and challenges when implementing this human-machine interactions in real life situations and health care. In this paper we explore people’s perceptions of the social robot Furhat when administering verbal tasks similar to those used in screening for Alzheimer’s disease. We describe the Slovak system mounted on the robot that includes a speech recognizer, the scenarios powered by generative large language model ChatGPT, and a speech synthesizer. We tested the functionality of the proposed approach with two groups of participants: attendees of a large science fair and a scientific conference. The observations from 87 collected questionnaires suggest good potential and applicability of such an approach for the given task and more positive attitudes of older subjects compared to younger ones.
Funding source: Agentúra na Podporu Výskumu a Vývoja
Award Identifier / Grant number: APVV-21-037
Funding source: European Cooperation in Science and Technology
Award Identifier / Grant number: CA19102 - Language In The Human-Machine Era
Funding source: Vedecká Grantová Agentúra MŠVVaŠ SR a SAV
Award Identifier / Grant number: 2/0165/21
Funding source: HORIZON EUROPE Marie Sklodowska-Curie Actions
Award Identifier / Grant number: Project Cobra No 859588
-
Research funding: This work was supported by APVV under the project APVV-21-0373 Diagnosis of Alzheimer’s disease from speech using artificial intelligence and social robotics; the work is also co-funded by VEGA project No 2/0165/21, EU ITN MSCA project Cobra No 859588 and COST MVTS CA19102 – Language In The Human-Machine Era (LITHME).
-
Declaration: All individuals listed as authors qualify as authors and have approved the submitted version. Their work is original and is not under consideration by any other journal. They have permission to reproduce any previously published material.
References
Al Moubayed, Samer, Jonas Beskow, and Gabriel Skantze. 2013. “The Furhat Social Companion Talking Head.” In Proceedings of INTERSPEECH, 747–9. ISCA.Suche in Google Scholar
Backonja, Uba, Amanda K. Hall, Ian Painter, Laura Kneale, Amanda Lazar, Maya Cakmak, and Hilaire J. Thompson, et al.. 2018. “Comfort and Attitudes Towards Robots Among Young, Middle-Aged, and Older Adults: A Cross-Sectional Study.” Journal of Nursing Scholarship 50 (6): 623–33, https://doi.org/10.1111/jnu.12430.Suche in Google Scholar
Beňuš, Štefan, Róbert Sabo, and Marián Trnka. 2019. “Word Guessing Game With a Social Robotic Head.” In CEUR Workshop Proceedings: Information Technologies - Application and Theory 2019, Vol. 2473, p. 1–5. Donovaly. ISSN 1613-0073.Suche in Google Scholar
Carros, Felix, Johanna Meurer, Diana Löffler, David Unbehaun, Sarah Matthies, Inga Koch, Rainer Wieching et al. 2020. “Exploring Human-Robot Interaction with the Elderly: Results from a Ten-Week Case Study in a Care Home.” In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–12.10.1145/3313831.3376402Suche in Google Scholar
Coco, Kirsi, Mari Kangasniemi, and Rantanen T. Teemu. 2018. “Care Personnel’s Attitudes and Fears Toward Care Robots in Elderly Care: A Comparison of Data from the Care Personnel in Finland and Japan.” Journal of Nursing Scholarship 50 (6): 634–44. https://doi.org/10.1111/jnu.12435.Suche in Google Scholar
Damholdt, Malene Flensborg, Marco Nørskov, Ryuji Yamazaki, Raul Hakli, Catharina Vesterager Hansen, Christina Vestergaard, and Johanna Seibt. 2015. “Attitudinal Change in Elderly Citizens Toward Social Robots: The Role of Personality Traits and Beliefs About Robot Functionality.” Frontiers in Psychology 6: 1701. https://doi.org/10.3389/fpsyg.2015.01701.Suche in Google Scholar
Ekstedt, Erik, and SkantzeGabriel. 2022. “Voice Activity Projection: Self-supervised Learning of Turn-taking Events.” In Proceedings of Interspeech, 5190–4.10.18653/v1/2020.findings-emnlp.268Suche in Google Scholar
Ekstedt, Erik, and Gabriel Skantze. 2020. “TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialog.” In Findings of the Association for Computational Linguistics: EMNLP 2020, 2981–90. ACM.10.21437/Interspeech.2022-10955Suche in Google Scholar
Huang, Tianyang, and Chiwu Huang. 2021. “Attitudes of the Elderly Living Independently Towards the Use of Robots to Assist with Activities of Daily Living.” Work 69 (1): 55–65. https://doi.org/10.3233/WOR-205166.Suche in Google Scholar
Hudson, John, Marta Orviska, and Jan Hunady. 2017. “People’s Attitudes to Robots in Caring for the Elderly.” International Journal of Social Robotics 9: 199–210. https://doi.org/10.1007/s12369-016-0384-5.Suche in Google Scholar
Irfan, Bahar, Sanna-Mari Kuoppamäki, and Gabriel Skantze. 2023. “Between Reality and Delusion: Challenges of Applying Large Language Models to Companion Robots for Open-Domain Dialogues with Older Adults.” Research Square. Ms. submitted to Autonomous Robots. https://doi.org/10.21203/rs.3.rs-2884789/v1.Suche in Google Scholar
Jacob, Dietmar. 2022. “Voice Controlled Devices and Older Adults – A Systematic Literature Review.” In Human Aspects of IT for the Aged Population. Design, Interaction and Technology Acceptance. HCII 2022. Lecture Notes in Computer Science, Vol. 13330, edited by Q. Gao, and J. Zhou. Cham: Springer.10.1007/978-3-031-05581-2_14Suche in Google Scholar
Libin, Alexander, and V. Libin Elena. 2008. “Person–robot Interactions from the Robopsychologists’ Point of View: The Robotic Psychology and Robotherapy Approach.” Proceedings of the IEEE 92: 1789–803.10.1109/JPROC.2004.835366Suche in Google Scholar
Lojka, Martin, Peter Viszlay, Ján Staš, Daniel Hládek, and Jozef Juhár. 2019. “Slovak Broadcast News Speech Recognition and Transcription System.” In Advances in Network-Based Information Systems. NBiS 2018, 22, edited by L. Barolli. Cham: Springer.10.1109/JPROC.2004.835366Suche in Google Scholar
Pérès, Karine, Alfonso Zamudio-Rodriguez, Jean-Francoi Dartigues, Helene Amieva and Stephane Lafitte. 2021. “Prospective Pragmatic Quasi-experimental Study to Assess the Impact and Effectiveness of an Innovative Large-Scale Public Health Intervention to Foster Healthy Ageing in Place: the Sobeezy Program Protocol.” BMJ Open 11 (4), e043082. https://doi.org/10.1136/bmjopen-2020-043082.Suche in Google Scholar
Piasek, Joanna, and Katarzyna Wieczorowska-Tobis. 2018. “Acceptance and Long-Term Use of a Social Robot by Elderly Users in a Domestic Environment,” In 11th International Conference on Human System Interaction (HSI), Gdansk, Poland, 478–82, https://doi.org/10.1109/HSI.2018.8431348.Suche in Google Scholar
Pino, Maribel, Melodie Boulay, Francois Jouen, and Anne-Sophie Rigaud. 2015. “Are We Ready for Robots That Care for Us? Attitudes and Opinions of Older Adults Toward Socially Assistive Robots.” Frontiers in Aging Neuroscience 7: 141. https://doi.org/10.3389/fnagi.2015.00141.Suche in Google Scholar
Povey, Daniel, Arnab Ghoshal, Gilles Boulianne, Lukas Burget, Ondrej Glembek, Nagendra Goel, and Mirko Hanneman, et al.. 2011. “The Kaldi Speech Recognition Toolkit.” In IEEE 2011 Workshop on Automatic Speech Recognition and Understanding, 2011. IEEE Signal Processing Society.10.3389/fnagi.2015.00141Suche in Google Scholar
Pleva, Matúš, and Jozef Juhar. 2014. “TUKE-BNews-SK: Slovak Broadcast News Corpus Construction and Evaluation.” In Proc. of LREC2014, 1709–13. Reykjavik, Iceland, ELRA.Suche in Google Scholar
Sabo, Róbert, Trnka, Marián, Rusko, Milan, Čiernik Kevická, and Štefan Beňuš. 2023. “Možnosti využitia sociálneho robota v zdravotníctve.” Fyzikálne faktory prostredia : riadne číslo časopisu o problematike fyzikálnych faktorov prostredia, roč. XIII, č. 2, s, 50–3.Suche in Google Scholar
Sayers, Dave, Rui Sousa-Silva, Sviatlana Höhn, Lule Ahmedi, Kais Allkivi-Metsoja, Dimitra Anastasiou, Štefan, Beňuš, et al. 2021. “The Dawn of the Human-Machine Era: A Forecast of New and Emerging Language Technologies.” Report for EU COST Action CA19102 ‘Language in the Human-Machine Era’. https://doi.org/10.17011/jyx/reports/20210518/1.Suche in Google Scholar
Siegel, Mikey, Cynthia Breazeal, and Michael I. Norton. 2009. “Persuasive Robotics: The Influence of Robot Gender on Human Behavior.” In: 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2563–8. St. Louis, MO, USA. https://doi.org/10.1109/IROS.2009.5354116.Suche in Google Scholar
Striegl, Julian, David Gollasch, Claudia Loitsch and Gerhard Weber. 2021. “Designing VUIS for Social Assistance Robots for People with Dementia.” In Mensch und Computer 2021, edited by S. Schneegass, B. Pfleging, D. Kern, 145–55. New York, NY: ACM.10.1109/IROS.2009.5354116Suche in Google Scholar
Sundar, S. Shyam. 2020. “Rise of Machine Agency: A Framework for Studying the Psychology of Human-AI Interaction (HAII).” Journal of Computer Mediated Communication 25: 74–88. https://doi.org/10.1093/jcmc/zmz026.Suche in Google Scholar
Taylor, Morag, and Jacqueline Close. 2018. “Dementia.” Handbook of Clinical Neurology 159: 303–21. https://doi.org/10.1016/B978-0-444-63916-5.00019-7.Suche in Google Scholar
Thunberg, Sofia, Maria Arnelid, and Tom Ziemke. 2022. “Older Adults’ Perception of the Furhat Robot.” In Proceedings of the 10th International Conference on Human-Agent Interaction., 4–12. ACM.10.1016/B978-0-444-63916-5.00019-7Suche in Google Scholar
© 2024 Walter de Gruyter GmbH, Berlin/Boston
Artikel in diesem Heft
- Frontmatter
- Research Articles
- Beyond Factories and Laboratories: Reflecting the Relationships Between Archivists and Historians
- The Subject of Black Subjectivity
- What Do You Mean by Trust? The Free Associations of the Word “Trust”
- Towards the Use of Social Robot Furhat and Generative AI in Testing Cognitive Abilities
- Differences in Indicators of Socio-Psychological Integration Between Refugees from Syria and Receiving Community in Croatia
- Promoting Science Communication for the Purpose of Pandemic Preparedness and Response: An Assessment of the Relevance of Pre-COVID Pandemic “early warnings”
- Exploring the Social Context of Self-directed Learning in the Contemporary Workplace
- Book Review
- Bianchi G:Figurations of Human Subjectivity. A Contribution to Second-Order Psychology
Artikel in diesem Heft
- Frontmatter
- Research Articles
- Beyond Factories and Laboratories: Reflecting the Relationships Between Archivists and Historians
- The Subject of Black Subjectivity
- What Do You Mean by Trust? The Free Associations of the Word “Trust”
- Towards the Use of Social Robot Furhat and Generative AI in Testing Cognitive Abilities
- Differences in Indicators of Socio-Psychological Integration Between Refugees from Syria and Receiving Community in Croatia
- Promoting Science Communication for the Purpose of Pandemic Preparedness and Response: An Assessment of the Relevance of Pre-COVID Pandemic “early warnings”
- Exploring the Social Context of Self-directed Learning in the Contemporary Workplace
- Book Review
- Bianchi G:Figurations of Human Subjectivity. A Contribution to Second-Order Psychology