Presentation 2012-07-19
Precisely Identified Object Tracking for Rendering Free-viewpoint Video in a Large Outdoor Space such as Soccer Game
Hiroshi SANKOH, Sei Naito,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In this paper, we propose a robust method of extracting precisely identified textures of multiple objects among multi-view cameras and consecutive frames for rendering an immersive free-viewpoint video in a large outdoor space such as a soccer stadium. For a free viewpoint video that provides viewers with an immersive experience, each object has to be identified consistently among all cameras for every frame to share textures of the same objects and replace them when an occlusion occurs. In order to achieve the above requirement, the proposed method extracts objects' silhouette regions and tracks each identified object by associating a tracking ID and a closed silhouette region for every camera. As the frame by frame process, the method checks whether or not occlusion occurs for each tracking region, and modifies the texture region by projecting the world coordinate of the object in SD-space, which is estimated in another non-occluded camera if it occurs. Experimental results revealed that the proposed method successfully extracted identified textures of multiple objects and improved the robustness for occlusions compared to the conventional method. Furthermore, it was also confirmed that the free-viewpoint video was rendered precisely with the proposed approach since the occluded regions were successfully reconstructed.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Free-viewpoint / tracking / multi-view / Particle Filter
Paper # MoMuC2012-15,IE2012-40
Date of Issue

Conference Information
Committee MoMuC
Conference Date 2012/7/12(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Mobile Multimedia Communications(MoMuC)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Precisely Identified Object Tracking for Rendering Free-viewpoint Video in a Large Outdoor Space such as Soccer Game
Sub Title (in English)
Keyword(1) Free-viewpoint
Keyword(2) tracking
Keyword(3) multi-view
Keyword(4) Particle Filter
1st Author's Name Hiroshi SANKOH
1st Author's Affiliation KDDI R&D Laboratories Inc.()
2nd Author's Name Sei Naito
2nd Author's Affiliation KDDI R&D Laboratories Inc.
Date 2012-07-19
Paper # MoMuC2012-15,IE2012-40
Volume (vol) vol.112
Number (no) 135
Page pp.pp.-
#Pages 6
Date of Issue