| Presentation | 2010-06-28 Dynamic Load Balancing of Data Stream Processing and Batch Processing Hiroya MATSUURA, Toyotaro SUZUMURA, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Data Stream Processing is the new computing paradigm for processing a massive amount of streaming data in real time without storing them on the secondary storage. In this paper we propose a dynamic load balancing mechanism between data stream processing jobs and traditional batch-typed jobs to realize an efficient operation of computer systems. Our implementation is built on top of System S, a distributed data stream processing system developed by IBM Research. Our experimental results show that our load balancing mechanism could execute 40 % more batch jobs when compared to the one with no load balancing. Moreover, the result shows that the latency for stream processing jobs are kept low even in a bursty situation by dynamically allocating more compute resources to stream processing jobs. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Data Stream Processing / Dynamic Load Balancing / DSMS / DSPS / System S / SPADE |
| Paper # | DE2010-13 |
| Date of Issue |
| Conference Information | |
| Committee | DE |
|---|---|
| Conference Date | 2010/6/21(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Data Engineering (DE) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Dynamic Load Balancing of Data Stream Processing and Batch Processing |
| Sub Title (in English) | |
| Keyword(1) | Data Stream Processing |
| Keyword(2) | Dynamic Load Balancing |
| Keyword(3) | DSMS |
| Keyword(4) | DSPS |
| Keyword(5) | System S |
| Keyword(6) | SPADE |
| 1st Author's Name | Hiroya MATSUURA |
| 1st Author's Affiliation | Tokyo Institute of Technology() |
| 2nd Author's Name | Toyotaro SUZUMURA |
| 2nd Author's Affiliation | Tokyo Institute of Technology:IBM Research-Tokyo |
| Date | 2010-06-28 |
| Paper # | DE2010-13 |
| Volume (vol) | vol.110 |
| Number (no) | 107 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |