Presentation 2018-03-09
[Encouragement Talk] Evaluation of the improvement method on the regular expressions generator for the log monitoring
Shinichiro Goto, Toyonori Fujiura, Masafumi Higuchi,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) We proposed the efficient generating method of whitelists for log monitoring, and showed its effectiveness. However, in order to apply the method to a large-scale and highly distributed IT systems, it is necessary to perform regular expression matching process with enormous log files and whitelist at high speed. In this paper, we evaluated the 3 methods for speeding up the regular expression matching process. We applied the 3 methods to logs of real system and measured each processing time. With dividing by keyword method, we confirmed reduction of processing time for all the logs, and the greater the number of keywords, the higher the reduction effect. With the other 2 methods, we confirmed the both cases where the reduction effect could be seen or not seen depending on the log files.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) System Operation / Monitoring / Log Monitoring / Whitelist / Regular Expression / Regular Expression Matching
Paper # ICM2017-72
Date of Issue 2018-03-01 (ICM)

Conference Information
Committee ICM
Conference Date 2018/3/8(2days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Toshio Tonouchi(NEC)
Vice Chair Yuji Nomura(Fujitsu Labs.) / Yoichi Yamashita(NTT-N)
Secretary Yuji Nomura(Fujitsu) / Yoichi Yamashita(KDDI R&D Labs.)
Assistant Haruo Ooishi(NTT)

Paper Information
Registration To Technical Committee on Information and Communication Management
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) [Encouragement Talk] Evaluation of the improvement method on the regular expressions generator for the log monitoring
Sub Title (in English)
Keyword(1) System Operation
Keyword(2) Monitoring
Keyword(3) Log Monitoring
Keyword(4) Whitelist
Keyword(5) Regular Expression
Keyword(6) Regular Expression Matching
1st Author's Name Shinichiro Goto
1st Author's Affiliation NIPPON TELEGRAPH AND TELEPHONE CORPORATION(NTT)
2nd Author's Name Toyonori Fujiura
2nd Author's Affiliation NIPPON TELEGRAPH AND TELEPHONE CORPORATION(NTT)
3rd Author's Name Masafumi Higuchi
3rd Author's Affiliation NIPPON TELEGRAPH AND TELEPHONE CORPORATION(NTT)
Date 2018-03-09
Paper # ICM2017-72
Volume (vol) vol.117
Number (no) ICM-491
Page pp.pp.97-101(ICM),
#Pages 5
Date of Issue 2018-03-01 (ICM)