| Presentation | 2012-03-09 Impact of the Interconnection Network Structure on Shuffle Completion Time in MapReduce Processing Tatsuma MATSUKI, Tatsuaki KIMURA, Tatsuya MORI, Tetsuya TAKINE, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | MapReduce processing, a typical distributed processing scheme in data centers, includes shuffle operation, where a massive amount of data are transferred between computation servers. In this article, we investigate the impact of the interconnection network structure on the shuffle completion time. For this purpose, we consider a simple tree structure and fat-tree strucure, and investigate their impact on the shuffle completion time through theoretical examination and simulation experiments. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | MapReduce processing / shuffle completion time / tree structure / fat-tree structure |
| Paper # | IN2011-200 |
| Date of Issue |
| Conference Information | |
| Committee | IN |
|---|---|
| Conference Date | 2012/3/1(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Information Networks (IN) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Impact of the Interconnection Network Structure on Shuffle Completion Time in MapReduce Processing |
| Sub Title (in English) | |
| Keyword(1) | MapReduce processing |
| Keyword(2) | shuffle completion time |
| Keyword(3) | tree structure |
| Keyword(4) | fat-tree structure |
| 1st Author's Name | Tatsuma MATSUKI |
| 1st Author's Affiliation | School of Engineering, Osaka University() |
| 2nd Author's Name | Tatsuaki KIMURA |
| 2nd Author's Affiliation | NTT Service Integration Laboratories |
| 3rd Author's Name | Tatsuya MORI |
| 3rd Author's Affiliation | NTT Service Integration Laboratories |
| 4th Author's Name | Tetsuya TAKINE |
| 4th Author's Affiliation | Graduate School of Engineering, Osaka University |
| Date | 2012-03-09 |
| Paper # | IN2011-200 |
| Volume (vol) | vol.111 |
| Number (no) | 469 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |