New feature-level video classification via temporal attention model

Hongje Seong, Suhan Woo, Junhyuk Hyun, Hyunbae Chang, Suhyeon Lee, Euntai Kim

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

CoVieW 2018 is a new challenge which aims at simultaneous scene and action recognition for untrimmed video [1]. In the challenge, frame-level video features extracted by pre-trained deep convolutional neural network (CNN) are provided for video-level classification. In this paper, a new approach for the video-level classification method is proposed. The proposed method focuses on the analysis in temporal domain and the temporal attention model is developed. To compensate for the differences in the lengths of various videos, temporal padding method is also developed to unify the lengths of videos. Further, data augmentation is performed to enhance some validation accuracy. Finally, for the train/validation in CoView 2018 dataset we recorded the performance of 95.53% accuracy in the scene and 87.17% accuracy in the action using temporal attention model, nonzero padding and data augmentation. The top-1 hamming score is the standard metric in the CoVieW 2018 challenge and 91.35% is obtained by the proposed method.

Original languageEnglish
Title of host publicationCoVieW 2018 - Proceedings of the 1st Workshop and Challenge on Comprehensive Video Understanding in the Wild, co-located with MM 2018
PublisherAssociation for Computing Machinery, Inc
Pages31-34
Number of pages4
ISBN (Electronic)9781450359764
DOIs
StatePublished - 15 Oct 2018
Event1st Workshop and Challenge on Comprehensive Video Understanding in the Wild, CoVieW 2018, in conjunction with ACM Multimedia, MM 2018 - Seoul, Korea, Republic of
Duration: 22 Oct 2018 → …

Publication series

NameCoVieW 2018 - Proceedings of the 1st Workshop and Challenge on Comprehensive Video Understanding in the Wild, co-located with MM 2018

Conference

Conference1st Workshop and Challenge on Comprehensive Video Understanding in the Wild, CoVieW 2018, in conjunction with ACM Multimedia, MM 2018
Country/TerritoryKorea, Republic of
CitySeoul
Period22/10/18 → …

Keywords

  • Convolutional neural network
  • CoVieW 2018
  • Data augmentation
  • Temporal attention
  • Temporal padding
  • Untrimmed video classification

Fingerprint

Dive into the research topics of 'New feature-level video classification via temporal attention model'. Together they form a unique fingerprint.

Cite this