| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2016-01-15 13:30 Workflow Transformation for Real-Time Big Data Processing Yuji Ishizuka, Wuhui Chen, Incheon Paik (University of Aizu)  SC2015-16 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | With the explosion of big data, processing and analyzing large numbers of continuous data streams in real-time, such as social media streams, sensor data streams, log streams, stock exchanges streams, etc., has become a crucial requirement for many scientific and industrial applications in recent years. Increased volume of streaming data as well as the demand for more complex real-time analytics require for execution of processing pipelines among heterogeneous event processing engines as a workflow. In this paper, we propose a workflow transformation for cost minimization in real-time big data processing. We first give the definition of stream-based workflow; and then we define eight different patterns as rules for workflow transformation; next, we give our workflow transformation algorithm based on our designed rules. Finally, our experiment shows that our proposed workflow transformation method can reduce the communication and computation cost effectively. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | big data processing / stream data / workflow transformation / geo-distributed data centers / workflow allocation / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 115, no. 393, SC2015-16, pp. 7-12, Jan. 2016. | |
| Paper # | SC2015-16 | |
| Date of Issue | 2016-01-08 (SC) | |
| ISSN | Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | SC2015-16 |
|
| Conference Information | |
| Committee | SC |
| Conference Date | 2016-01-15 - 2016-01-15 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kyoto University (Design Innovation Center) |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Cloud, IoT, and Service Innovation |
| Paper Information | |
| Registration To | SC |
| Conference Code | 2016-01-SC |
| Language | English |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Workflow Transformation for Real-Time Big Data Processing |
| Sub Title (in English) | |
| Keyword(1) | big data processing |
| Keyword(2) | stream data |
| Keyword(3) | workflow transformation |
| Keyword(4) | geo-distributed data centers |
| Keyword(5) | workflow allocation |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Yuji Ishizuka |
| 1st Author's Affiliation | University of Aizu (University of Aizu) |
| 2nd Author's Name | Wuhui Chen |
| 2nd Author's Affiliation | University of Aizu (University of Aizu) |
| 3rd Author's Name | Incheon Paik |
| 3rd Author's Affiliation | University of Aizu (University of Aizu) |
| 4th Author's Name | |
| 4th Author's Affiliation | () |
| 5th Author's Name | |
| 5th Author's Affiliation | () |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2016-01-15 13:30:00 |
| Presentation Time | 25 minutes |
| Registration for | SC |
| Paper # | SC2015-16 |
| Volume (vol) | vol.115 |
| Number (no) | no.393 |
| Page | pp.7-12 |
| #Pages | 6 |
| Date of Issue | 2016-01-08 (SC) |
[Return to Top Page]