Paper Abstract and Keywords |
Presentation |
2013-08-02 16:15
A High Throughput Network Framework for Distributed CEP Kenji Kobayashi, Toshiaki Saeki, Emeric Viel, Nobutaka Imamura, Masazumi Matsubara, Haruyasu Ueda, Yoshinori Sakamoto (Fujitsu Lab.) CPSY2013-26 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
Distributed CEP is big data processing platform that can process many events in real-time. In a distributed CEP system, many events must be transferred between each processing node. To limit the impact of those transfers on performance, it is important to use a high-throughput communication method. We have been developing a distributed CEP system using Java for productivity reasons. However, throughput has been impacted by the serialization and de-serialization of Java objects. To address this problem, we propose a combination of two methods: binary class packing and delayed deserialization. With binary class packing, events can be processed without unnecessary de-serialization. With delayed deserialization, de-serialization is delayed until it is required. In our evaluation, we found that, compared to existing methods, binary class packing improves throughput by 4.7 times, and delayed deserialization improves throughput by 3.4 times. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Complex Event Processing(CEP) / Java / Network / Serialize / Deserialize / Throughput / / |
Reference Info. |
IEICE Tech. Rep., vol. 113, no. 169, CPSY2013-26, pp. 97-102, Aug. 2013. |
Paper # |
CPSY2013-26 |
Date of Issue |
2013-07-25 (CPSY) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
CPSY2013-26 |
|