Presentation 2020-01-23
NIDP: Low-Latency Networking without Customizing Application in Virtual Server
Kei Fujimoto, Arai Maiko, Yusuke Ogata, Matsui Kenichi,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Packet processing on commodity hardware is a cost-efficient and flexible alternative to specialized networking hardware. However, virtualizing dedicated networking hardware as a virtual machine on a commodity server results in performance problems, such as longer latency and lower throughput. This paper focuses on obtaining a low-latency data path in a virtual server. We reveal mechanisms that cause millisecond-scale networking delays in a virtual server through a series of experiments. To suppress such delays, we designed and implemented the non-interruptive data path (NIDP), which achieves three goals: (1) microsecond-scale tail delays and high throughput in a virtual server, (2) no application customizing is required, applications can use the POSIX sockets application program interface, and (3) no Linux kernel customizing is required. The NIDP achieves these goals by adopting an architecture of interworking between user-space networking and guest-kernel networking to prevent softIRQ competition, create a run-to-completion model, and reduce buffer copy. Evaluation results indicate that the NIDP achieves microsecond-scale tail delays and reduces 98.2% maximum round-trip latency compared to the Open vSwitch with Data Plane Development Kit (OvS-DPDK) and 98.3% maximum round-trip latency compared to the DPDK Kernel NIC Interface (KNI) at 1-Gbps traffic rate with 1518-byte User Datagram Protocol (UDP) frames. The NIDP achieves up to 1.92× higher throughput than the OvS-DPDK and 1.88× higher throughput than the KNI with 1518-byte UDP frames.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) low latency / network / kernel / virtual server
Paper # NS2019-165
Date of Issue 2020-01-16 (NS)

Conference Information
Committee NS
Conference Date 2020/1/23(2days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English) Network software (Software architecture, Middleware), Network application, SOA/SDP, NGN/IMS/API, Distributed control/Dynamic routing, Grid, NFV, IoT, Network/System reliability, Network/System evaluation, etc.
Chair Yoshikatsu Okazaki(NTT)
Vice Chair Akihiro Nakao(Univ. of Tokyo)
Secretary Akihiro Nakao(Osaka Pref Univ.)
Assistant Shinya Kawano(NTT)

Paper Information
Registration To Technical Committee on Network Systems
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) NIDP: Low-Latency Networking without Customizing Application in Virtual Server
Sub Title (in English)
Keyword(1) low latency
Keyword(2) network
Keyword(3) kernel
Keyword(4) virtual server
1st Author's Name Kei Fujimoto
1st Author's Affiliation NTT Corporation(NTT)
2nd Author's Name Arai Maiko
2nd Author's Affiliation NTT Corporation(NTT)
3rd Author's Name Yusuke Ogata
3rd Author's Affiliation NTT Corporation(NTT)
4th Author's Name Matsui Kenichi
4th Author's Affiliation NTT Corporation(NTT)
Date 2020-01-23
Paper # NS2019-165
Volume (vol) vol.119
Number (no) NS-383
Page pp.pp.25-30(NS),
#Pages 6
Date of Issue 2020-01-16 (NS)