| Presentation | 1998/1/22 Video Generation and Summarization by Utilizing Speech and Motion Analysis Yoshifumi KIMURA, Ye YU, Yuichi NAKAMURA, Yuichi OHTA, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | This paper introduces a novel method for presentation video generation and summarization, which uses language information taken from the speech and the speaker's motion. This method mainly deals with detecting "focus segments" which should be paid attention, and summarizes a video by those relevant segments. For this purpose, it utilizes deictic expressions, typical verbs, along with motion information, by giving scores to them based on the statistics over presentation videos of more than two hours. We applied this method to real presentation videos, and evaluated its effectiveness. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | video generation / video analysis / multimodal analysis / presentation video analysis / integration of motion and speech analysis |
| Paper # | PRMU97-197 |
| Date of Issue |
| Conference Information | |
| Committee | PRMU |
|---|---|
| Conference Date | 1998/1/22(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Pattern Recognition and Media Understanding (PRMU) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Video Generation and Summarization by Utilizing Speech and Motion Analysis |
| Sub Title (in English) | |
| Keyword(1) | video generation |
| Keyword(2) | video analysis |
| Keyword(3) | multimodal analysis |
| Keyword(4) | presentation video analysis |
| Keyword(5) | integration of motion and speech analysis |
| 1st Author's Name | Yoshifumi KIMURA |
| 1st Author's Affiliation | Institute of Information Sciences and Electronics, University of Tsukuba() |
| 2nd Author's Name | Ye YU |
| 2nd Author's Affiliation | Institute of Information Sciences and Electronics, University of Tsukuba |
| 3rd Author's Name | Yuichi NAKAMURA |
| 3rd Author's Affiliation | Institute of Information Sciences and Electronics, University of Tsukuba |
| 4th Author's Name | Yuichi OHTA |
| 4th Author's Affiliation | Institute of Information Sciences and Electronics, University of Tsukuba |
| Date | 1998/1/22 |
| Paper # | PRMU97-197 |
| Volume (vol) | vol.97 |
| Number (no) | 500 |
| Page | pp.pp.- |
| #Pages | 8 |
| Date of Issue | |