Summary
2021
Session Number:PS1
Session:
Number:PS1-13
Docker Container Networking Based Apache Storm and Flink Benchmark Test
Tao Liu, Zhihong Yang, Yuzhong Sun,
pp.49-52
Publication Date:2021/9/8
Online ISSN:2188-5079
Summary:
Many distributed stream computing engines have emerged to handle big data, and they can be deployed in cloud environments consisting of native networks or container networks. Most of the benchmark research on stream computing engines are carried out under the native network, and the research on the impact on container network on stream computing engines is currently inadequate. However, the use of container network will inevitably lead to performance degradation, which is the disadvantage of all virtual networks. In this work, we build Apache Storm and Apache Flink, which are Streaming Computation Engines in container network and native network environments and conduct performance measurements through experiments processing textual data to verify how much performance decreases in container network. Experiments show that the throughput in a container network environment is 1%-5% lower and CPU utilization is 11%-18% lower than in a local network environment.