| Presentation | 2005/7/29 A scheduling system coupled with a replica management system for data-intensive applications Yuya MACHIDA, Shinichiro TAKIZAWA, Hidemoto NAKADA, Satoshi MATSUOKA, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Existing scheduling systems for the Grid mostly handle huge I/O via a shared file system or simple staging. However, when numerous nodes access a single I/O node simultaneously, major performance degradation occurs, or in a worst case, causes I/O nodes to hang. Moreover, when a user launches a job consisting of hundreds or even thousands of tasks which share the same data set, it becomes extremely inefficient to stage essentially the same data set to each compute node after every dynamic brokering and allocation of the compute nodes. Instead, we propose to utilize a replica management system that embodies a scalable multi-replication framework as a data staging mechanism, where multiple copies could be made in O(1) transfer time as well as make intelligent reuse of already-created replicas in scheduling for efficiency. A prototype executing a sample data-intensive application proved to be quite superior to shared files or traditional staging techniques. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Grid / Scheduling / Replica Management System / Data-Intensive Application |
| Paper # | CPSY2005-26 |
| Date of Issue |
| Conference Information | |
| Committee | CPSY |
|---|---|
| Conference Date | 2005/7/29(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Computer Systems (CPSY) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A scheduling system coupled with a replica management system for data-intensive applications |
| Sub Title (in English) | |
| Keyword(1) | Grid |
| Keyword(2) | Scheduling |
| Keyword(3) | Replica Management System |
| Keyword(4) | Data-Intensive Application |
| 1st Author's Name | Yuya MACHIDA |
| 1st Author's Affiliation | Tokyo Institute of Technology() |
| 2nd Author's Name | Shinichiro TAKIZAWA |
| 2nd Author's Affiliation | Tokyo Institute of Technology |
| 3rd Author's Name | Hidemoto NAKADA |
| 3rd Author's Affiliation | National Institute of Advanced Industrial Science and Technology |
| 4th Author's Name | Satoshi MATSUOKA |
| 4th Author's Affiliation | Tokyo Institute of Technology:National Institute of Informatics |
| Date | 2005/7/29 |
| Paper # | CPSY2005-26 |
| Volume (vol) | vol.105 |
| Number (no) | 226 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |