| Presentation | 2006-07-13 Dependable Data Stream Processing in Distributed Environment Yousuke WATANABE, Shinichi YAMADA, Hiroyuki KITAGAWA, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Data streams are information sources that continuously provide information changing over time. Examples of data streams are sensor data, log data and so on. Since demands for query processing over data streams are increasing, data stream processing engines become more and more important. For many stream applications, suspension of query processing and data loss caused by node failures and network failures are quite serious problems. Therefore, high availability of data stream processing engines is required. We propose a sustainable data stream processing system in distributed environments, based on a data stream processing engine StreamSpinner which we have developed. Our approach is based on collaboration of data stream processing engine and virtual machine technologies. StreamSpinner is executed on a virtual machine in a node, and the node periodically saves a snapshot of the running virtual machine. When the node crashes, other node recovers the virtual machine from the snapshot, and an alternative node continues query processing. This paper shows an architecture of our system. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Data Stream / Availability / Recovery / Virtual Machine Technology |
| Paper # | DE2006-84 |
| Date of Issue |
| Conference Information | |
| Committee | DE |
|---|---|
| Conference Date | 2006/7/6(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Data Engineering (DE) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Dependable Data Stream Processing in Distributed Environment |
| Sub Title (in English) | |
| Keyword(1) | Data Stream |
| Keyword(2) | Availability |
| Keyword(3) | Recovery |
| Keyword(4) | Virtual Machine Technology |
| 1st Author's Name | Yousuke WATANABE |
| 1st Author's Affiliation | Core Research for Evolutional Science and Technology, Japan Science and Technology Agency() |
| 2nd Author's Name | Shinichi YAMADA |
| 2nd Author's Affiliation | Graduate School of Systems and Information Engineering, University of Tsukuba |
| 3rd Author's Name | Hiroyuki KITAGAWA |
| 3rd Author's Affiliation | Graduate School of Systems and Information Engineering, University of Tsukuba:Center for Computational Sciences, University of Tsukuba |
| Date | 2006-07-13 |
| Paper # | DE2006-84 |
| Volume (vol) | vol.106 |
| Number (no) | 149 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |