| Presentation | 2013-06-17 High Performance of Big Data Processing via NICT Science Cloud Fusako ISODA, Ken T. MURATA, Hidenobu WATANABE, Keiichiro FUKAZAWA, Kazunori YAMAMOTO, Osamu TATEBE, Masahiro TANAKA, Eizen KIMURA, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Science cloud is a cloud system designed for scientific researches, and expected as a new infrastructure for big data sciences. Not only parallelization of CPU as in super-computers, but I/O and network throughput parallelization are crucial for the big data science. One of the typical structures of science cloud is a scalable cluster in which multiple clusters in a cloud are connected with high-speed network. In the present study, we study a performance of parallelization of both CPU and I/O inside a cloud as a first step to the high performance scalable clusters. In case with few processes executed on each computational node (server), parallelization efficiency is almost 100%. This high efficiency is expected to maintain in larger-scale cluster systems such as those with 100 servers. On the other hand, under the condition of multi-processes on each node, the present parallelization does not show good performance due to the congestions of I/O. Parallelization efficiency is as low as 15.6. New techniques of decentralization of I/O within each node are required in the next step. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Science Cloud / Gfarm / pwrake / Big data / Magnetspheric MHD simulation |
| Paper # | SC2013-4 |
| Date of Issue |
| Conference Information | |
| Committee | SC |
|---|---|
| Conference Date | 2013/6/10(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Services Computing (SC) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | High Performance of Big Data Processing via NICT Science Cloud |
| Sub Title (in English) | |
| Keyword(1) | Science Cloud |
| Keyword(2) | Gfarm |
| Keyword(3) | pwrake |
| Keyword(4) | Big data |
| Keyword(5) | Magnetspheric MHD simulation |
| 1st Author's Name | Fusako ISODA |
| 1st Author's Affiliation | Science Service Co., LTD() |
| 2nd Author's Name | Ken T. MURATA |
| 2nd Author's Affiliation | National Institute of Information and Communications Technology |
| 3rd Author's Name | Hidenobu WATANABE |
| 3rd Author's Affiliation | National Institute of Information and Communications Technology |
| 4th Author's Name | Keiichiro FUKAZAWA |
| 4th Author's Affiliation | Research Institute for Information Technology, Kyushu University |
| 5th Author's Name | Kazunori YAMAMOTO |
| 5th Author's Affiliation | National Institute of Information and Communications Technology |
| 6th Author's Name | Osamu TATEBE |
| 6th Author's Affiliation | Center for Computational Sciences, University of Tsukuba |
| 7th Author's Name | Masahiro TANAKA |
| 7th Author's Affiliation | Center for Computational Sciences, University of Tsukuba |
| 8th Author's Name | Eizen KIMURA |
| 8th Author's Affiliation | Department of Medical Informatics Ehime University |
| Date | 2013-06-17 |
| Paper # | SC2013-4 |
| Volume (vol) | vol.113 |
| Number (no) | 86 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |