Sangam: A Confluence of Knowledge Streams

Learning Activities From Human Demonstration Videos

Show simple item record

dc.contributor Crandall, David J.
dc.creator Lee, Jangwon
dc.date 2018-11-27T21:59:07Z
dc.date 2018-11-27T21:59:07Z
dc.date 2018-11
dc.date.accessioned 2023-02-21T11:21:25Z
dc.date.available 2023-02-21T11:21:25Z
dc.identifier http://hdl.handle.net/2022/22549
dc.identifier.uri http://localhost:8080/xmlui/handle/CUHPOERS/253150
dc.description Thesis (Ph.D.) - Indiana University, School of Informatics, Computing, and Engineering, 2018
dc.description In this thesis we describe novel computer vision approaches to observe and learn activities from human demonstration videos. We specifically focus on using first-person and close up videos for learning new activities, rather than traditional third-person videos that have static and global fields of view. Since the specific objective of these studies is to build intelligent agents that can interact with people, these types of videos are beneficial for understanding human movements, because first-person and close up videos are generally goal-oriented and have similar viewpoints as those of intelligent agents. We present new Convolutional Neural Network (CNN) based approaches to learn the spatial/temporal structure of the demonstrated human actions, and use the learned structure and models to analyze human behaviors in new videos. We then demonstrate intelligent systems based on the proposed approaches in two contexts: (i) collaborative robot systems to assist users with daily tasks, and (ii) an educational scenario in which a system gives feedback on their movements. Finally, we experimentally evaluate our approach in enabling intelligent systems to observe and learn from human demonstration videos.
dc.language en
dc.publisher [Bloomington, Ind.] : Indiana University
dc.subject Convolutional Neural Network
dc.subject Intelligent Systems
dc.subject Learning from Demonstration
dc.subject Human-Robot Collaboration
dc.subject Early Recognition
dc.title Learning Activities From Human Demonstration Videos
dc.type Doctoral Dissertation


Files in this item

Files Size Format View
Thesis_JangwonLee_Nov_2018.pdf 7.491Mb application/pdf View/Open

This item appears in the following Collection(s)

Show simple item record

Search DSpace


Advanced Search

Browse