| Presentation | 2013-10-04 NICT Science Cloud : Big-data Analyses via Parallel and Distributed Processing Technique for Earth and Space Science Fusako ISODA, Ken T., Hidenobu WATANABE, Keiichiro FUKAZAWA, Kazunori YAMAMOTO, Yasufumi KUBOTA, Yasuko KASAI, Shinsuke SATOH, Kentaro UKAWA, Kazuya MURANAGA, Yutaka SUZUKI, Takashi KUROSAWA, Eizen KIMURA, Osamu TATEBE, Masahiro TANAKA, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Science cloud is a cloud system designed for scientific researches, and expected as a new infrastructure for big data sciences. Not only parallelization of CPU as in super-computers, but I/O and network throughput parallelization are crucial for the big data science. One of the typical structures of science cloud is a scalable cluster in which multiple clusters in a cloud are connected with high-speed network. In the present study, we study a performance of parallelization of both CPU and I/O inside a cloud as a first step to the high performance scalable clusters. In case with few processes executed on each computational node (server), parallelization efficiency is almost 100%. This high efficiency is expected to maintain in larger-scale cluster systems such as those with 30 servers. On the other hand, under the condition of multi-processes on each node, the present parallelization does not show good performance due to the congestions of I/O. Parallelization efficiency is as low as 15.6. New techniques of decentralization of I/O within each node are required in the next step. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Science Cloud / Gfarm / Pwrake / Big data / Earth Environment Science / Space Environment Science |
| Paper # | PRMU2013-62 |
| Date of Issue |
| Conference Information | |
| Committee | PRMU |
|---|---|
| Conference Date | 2013/9/26(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Pattern Recognition and Media Understanding (PRMU) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | NICT Science Cloud : Big-data Analyses via Parallel and Distributed Processing Technique for Earth and Space Science |
| Sub Title (in English) | |
| Keyword(1) | Science Cloud |
| Keyword(2) | Gfarm |
| Keyword(3) | Pwrake |
| Keyword(4) | Big data |
| Keyword(5) | Earth Environment Science |
| Keyword(6) | Space Environment Science |
| 1st Author's Name | Fusako ISODA |
| 1st Author's Affiliation | Sciece Service Co., LTD.() |
| 2nd Author's Name | Ken T. |
| 2nd Author's Affiliation | National Institute of Information and Communications Technology |
| 3rd Author's Name | Hidenobu WATANABE |
| 3rd Author's Affiliation | National Institute of Information and Communications Technology |
| 4th Author's Name | Keiichiro FUKAZAWA |
| 4th Author's Affiliation | Research Institute for Information Technology, Kyushu University |
| 5th Author's Name | Kazunori YAMAMOTO |
| 5th Author's Affiliation | National Institute of Information and Communications Technology |
| 6th Author's Name | Yasufumi KUBOTA |
| 6th Author's Affiliation | National Institute of Information and Communications Technology |
| 7th Author's Name | Yasuko KASAI |
| 7th Author's Affiliation | National Institute of Information and Communications Technology |
| 8th Author's Name | Shinsuke SATOH |
| 8th Author's Affiliation | National Institute of Information and Communications Technology |
| 9th Author's Name | Kentaro UKAWA |
| 9th Author's Affiliation | Systems Engineering Consultants Co., LTD. |
| 10th Author's Name | Kazuya MURANAGA |
| 10th Author's Affiliation | Systems Engineering Consultants Co., LTD. |
| 11th Author's Name | Yutaka SUZUKI |
| 11th Author's Affiliation | Systems Engineering Consultants Co., LTD. |
| 12th Author's Name | Takashi KUROSAWA |
| 12th Author's Affiliation | Hitachi Solutions East Japan, Ltd. |
| 13th Author's Name | Eizen KIMURA |
| 13th Author's Affiliation | Department of Medical Informatics Ehime University |
| 14th Author's Name | Osamu TATEBE |
| 14th Author's Affiliation | Center for Computational Sciences, University of Tsukuba |
| 15th Author's Name | Masahiro TANAKA |
| 15th Author's Affiliation | Center for Computational Sciences, University of Tsukuba |
| Date | 2013-10-04 |
| Paper # | PRMU2013-62 |
| Volume (vol) | vol.113 |
| Number (no) | 230 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |