JIPS (한국정보처리학회)
Current Result Document :
| 한글제목(Korean Title) |
Video Captioning with Visual and Semantic Features |
| 영문제목(English Title) |
Video Captioning with Visual and Semantic Features |
| 저자(Author) |
Sujin Lee
Incheol Kim
|
| 원문수록처(Citation) |
VOL 14 NO. 06 PP. 1318 ~ 1330 (2018. 12) |
한글내용
(Korean Abstract) |
|
영문내용
(English Abstract) |
Video captioning refers to the process of extracting features from a video and generating video captions using the extracted features. This paper introduces a deep neural network model and its learning method for effective video captioning. In this study, visual features as well as semantic features, which effectively express the video, are also used. The visual features of the video are extracted using convolutional neural networks, such as C3D and ResNet, while the semantic features are extracted using a semantic feature extraction network proposed in this paper. Further, an attention-based caption generation network is proposed for effective generation of video captions using the extracted features. The performance and effectiveness of the proposed model is verified through various experiments using two large-scale video benchmarks such as the Microsoft Video Description (MSVD) and the Microsoft Research Video-To-Text (MSR-VTT).
|
| 키워드(Keyword) |
Attention-Based Caption Generation
Deep Neural Networks
Semantic Feature
Video Captioning
|
| 파일첨부 |
PDF 다운로드
|
