| Presentation | 2016-01-15 Workflow Transformation for Real-Time Big Data Processing Yuji Ishizuka, Wuhui Chen, Incheon Paik, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | With the explosion of big data, processing and analyzing large numbers of continuous data streams in real-time, such as social media streams, sensor data streams, log streams, stock exchanges streams, etc., has become a crucial requirement for many scientific and industrial applications in recent years. Increased volume of streaming data as well as the demand for more complex real-time analytics require for execution of processing pipelines among heterogeneous event processing engines as a workflow. In this paper, we propose a workflow transformation for cost minimization in real-time big data processing. We first give the definition of stream-based workflow; and then we define eight different patterns as rules for workflow transformation; next, we give our workflow transformation algorithm based on our designed rules. Finally, our experiment shows that our proposed workflow transformation method can reduce the communication and computation cost effectively. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | big data processingstream dataworkflow transformationgeo-distributed data centersworkflow allocation |
| Paper # | SC2015-16 |
| Date of Issue | 2016-01-08 (SC) |
| Conference Information | |
| Committee | SC |
|---|---|
| Conference Date | 2016/1/15(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kyoto University (Design Innovation Center) |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Cloud, IoT, and Service Innovation |
| Chair | Shigeru Hosono(NEC) |
| Vice Chair | Incheon Paik(Univ. of Aizu) |
| Secretary | Incheon Paik(NICT) |
| Assistant | |
| Paper Information | |
| Registration To | Technical Committee on Service Computing |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Workflow Transformation for Real-Time Big Data Processing |
| Sub Title (in English) | |
| Keyword(1) | big data processingstream dataworkflow transformationgeo-distributed data centersworkflow allocation |
| 1st Author's Name | Yuji Ishizuka |
| 1st Author's Affiliation | University of Aizu(University of Aizu) |
| 2nd Author's Name | Wuhui Chen |
| 2nd Author's Affiliation | University of Aizu(University of Aizu) |
| 3rd Author's Name | Incheon Paik |
| 3rd Author's Affiliation | University of Aizu(University of Aizu) |
| Date | 2016-01-15 |
| Paper # | SC2015-16 |
| Volume (vol) | vol.115 |
| Number (no) | SC-393 |
| Page | pp.pp.7-12(SC), |
| #Pages | 6 |
| Date of Issue | 2016-01-08 (SC) |