A Cloud-Based Extensible Avatar For Human Robot Interaction

Simple item page
dc.contributor.advisorJenkin, Michael
dc.creatorAlTarawneh, Enas Khaled Ahm
dc.date.accessioned2019-07-02T16:11:10Z
dc.date.available2019-07-02T16:11:10Z
dc.date.copyright2019-02-04
dc.date.issued2019-07-02
dc.date.updated2019-07-02T16:11:10Z
dc.degree.disciplineElectrical Engineering and Computer Science
dc.degree.levelMaster's
dc.degree.nameMSc - Master of Science
dc.description.abstractAdding an interactive avatar to a human-robot interface requires the development of tools that animate the avatar so as to simulate an intelligent conversation partner. Here we describe a toolkit that supports interactive avatar modeling for human-computer interaction. The toolkit utilizes cloud-based speech-to-text software that provides active listening, a cloud-based AI to generate appropriate textual responses to user queries, and a cloud-based text-to-speech generation engine to generate utterances for this text. This output is combined with a cloud-based 3D avatar animation synchronized to the spoken response. Generated text responses are embedded within an XML structure that allows for tuning the nature of the avatar animation to simulate different emotional states. An expression package controls the avatar's facial expressions. The introduced rendering latency is obscured through parallel processing and an idle loop process that animates the avatar between utterances. The efficiency of the approach is validated through a formal user study.
dc.identifier.urihttp://hdl.handle.net/10315/36254
dc.language.isoen
dc.rightsAuthor owns copyright, except where explicitly noted. Please contact the author directly with licensing requests.
dc.subject.keywordsHCI
dc.subject.keywordsHRI
dc.subject.keywordsRobotics
dc.subject.keywordsAvatar
dc.subject.keywordsText-to-speech
dc.subject.keywordsSpeech-to-text
dc.subject.keywordsAI
dc.subject.keywordsCloud-Based
dc.subject.keywordsParallel processing
dc.subject.keywordsDistributed processing
dc.subject.keywordsArtificial intelligence
dc.subject.keywordsHuman-computer Interaction
dc.subject.keywordsHuman-robot interaction
dc.subject.keywordsRendering
dc.subject.keywordsAnimation
dc.subject.keywordsXML
dc.titleA Cloud-Based Extensible Avatar For Human Robot Interaction
dc.typeElectronic Thesis or Dissertation

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Altarawneh_Enas_K_2016_Masters.pdf
Size:
13.33 MB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
YorkU_ETDlicense.txt
Size:
3.39 KB
Format:
Plain Text
Description:
Download
No Thumbnail Available
Name:
license.txt
Size:
1.87 KB
Format:
Plain Text
Description:
Download

Collections

Electrical Engineering and Computer Science

All items in the YorkSpace institutional repository are protected by copyright, with all rights reserved except where explicitly noted.