Publications

Context-Sensitive Human Activity Classification in Collaborative Learning Environments

Description

Human activity classification remains challenging due to the strong need to eliminate structural noise, the multitude of possible activities, and the strong variations in video acquisition. The current paper explores the study of human activity classification in a collaborative learning environment.This paper explores the use of color based object detection in conjunction with contextualization of object interaction to isolate motion vectors specific to each human activity. The basic approach is to make use of separate classifiers for each activity. Here, we consider the detection of typing, writing, and talking activities in raw videos.The method was tested using 43 uncropped video clips with 620 video frames for writing, 1050 for typing, and 1755 frames for talking. Using simple KNN classifiers, the method gave accuracies of 72.6% for writing, 71% for typing and 84.6% for talking. Classification accuracy improved to 92.5% (writing), 82.5% (typing) and 99.7% (talking) with the use of Deep Neural Networks.

Publications

Author and publisher information is provided below. Note that many publishers charge a fee or membership for full access. Permission/access must be requested through the publisher or author directly.

PUBLICATION DETAILS

Type
Conference proceeding
Author
A.R. Jacoby
M. Pattichis
S. Celedon-Pattichis
C. LopezLeiva
Publisher
Signals Systems and Computers 2018 52nd Asilomar Conference
Publication Year
2018