Recognize Human Activities from Partially Observed Videos

Yu Cao, Daniel Barrett, Andrei Barbu, Siddharth Narayanaswamy, Haonan Yu, Aaron Michaux, Yuewei Lin, Sven Dickinson, Jeffrey Mark Siskind, Song Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recognizing human activities in partially observed videos is a challenging problem and has many practical applications. When the unobserved subsequence is at the end of the video, the problem is reduced to activity prediction from unfinished activity streaming, which has been studied by many researchers. However, in the general case, an unobserved subsequence may occur at any time by yielding a temporal gap in the video. In this paper, we propose a new method that can recognize human activities from partially observed videos in the general case. Specifically, we formulate the problem into a probabilistic framework: 1) dividing each activity into multiple ordered temporal segments, 2) using spatiotemporal features of the training video samples in each segment as bases and applying sparse coding (SC) to derive the activity likelihood of the test video sample at each segment, and 3) finally combining the likelihood at each segment to achieve a global posterior for the activities. We further extend the proposed method to include more bases that correspond to a mixture of segments with different temporal lengths (MSSC), which can better represent the activities with large intra-class variations. We evaluate the proposed methods (SC and MSSC) on various real videos. We also evaluate the proposed methods on two special cases: 1) activity prediction where the unobserved subsequence is at the end of the video, and 2) human activity recognition on fully observed videos. Experimental results show that the proposed methods outperform existing state-of-the-art comparison methods.
Original languageEnglish
Title of host publication2013 IEEE Conference on Computer Vision and Pattern Recognition
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages2658-2665
Number of pages8
ISBN (Electronic)978-1-5386-5672-3
DOIs
Publication statusPublished - 3 Oct 2013
Event26th IEEE Conference on Computer Vision and Pattern Recognition - Portland, United States
Duration: 23 Jun 201328 Jun 2013
http://www.pamitc.org/cvpr13/

Publication series

Name
PublisherIEEE
ISSN (Print)1063-6919
ISSN (Electronic)1063-6919

Conference

Conference26th IEEE Conference on Computer Vision and Pattern Recognition
Abbreviated titleCVPR 2013
Country/TerritoryUnited States
CityPortland
Period23/06/1328/06/13
Internet address

Cite this