Presentation 2016-03-25
Towards a Breakdown of a Benchmark Score Without Internal Analysis of the Benchmarking Program
Naoki Matagawa, Kazuyuki Shudo,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) A breakdown of a benchmark score is how much each aspect of the system performance affects the score. Existing methods require internal analysis on the benchmarking program and then involve the following problems: (1) require a certain amount of labor for code analysis, profiling, simulation and so on and (2) require the benchmarking program itself. In this paper, we present a method for breaking down a benchmark score without internal analysis of the benchmarking program. The method utilizes confirmatory factor analysis of benchmark scores on a number of systems. Experimental results with 3 benchmarks on 15 Android systems showed that our method could break down those benchmark scores even though there is room for improvement in accuracy.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) benchmarking / performance modeling / execution time estimation / factor analysis
Paper # CPSY2015-151,DC2015-105
Date of Issue 2016-03-17 (CPSY, DC)

Conference Information
Committee CPSY / DC / IPSJ-SLDM / IPSJ-EMB / IPSJ-ARC
Conference Date 2016/3/24(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Fukue Bunka Hall/Rodou Fukushi Center
Topics (in Japanese) (See Japanese page)
Topics (in English) ETNET2016
Chair Yasuhiko Nakashima(NAIST) / Nobuyasu Kanekawa(Hitachi) / Masahiro Fukui(Ritsumeikan Univ.)
Vice Chair Koji Nakano(Hiroshima Univ.) / Hidetsugu Irie(Univ. of Tokyo) / Michiko Inoue(NAIST)
Secretary Koji Nakano(Fujitsu Labs.) / Hidetsugu Irie(NII) / Michiko Inoue(RTRI) / (Kyoto Sangyo Univ.) / (Sharp) / (Kitakyushu City Univ.)
Assistant Shinya Takameda(NAIST) / Takeshi Ohkawa(Utsunomiya Univ.)

Paper Information
Registration To Technical Committee on Computer Systems / Technical Committee on Dependable Computing / Special Interest Group on System and LSI Design Methodology / Special Interest Group on Embedded Systems / Special Interest Group on System Architecture
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Towards a Breakdown of a Benchmark Score Without Internal Analysis of the Benchmarking Program
Sub Title (in English)
Keyword(1) benchmarking
Keyword(2) performance modeling
Keyword(3) execution time estimation
Keyword(4) factor analysis
1st Author's Name Naoki Matagawa
1st Author's Affiliation Tokyo Institute of Technology(Tokyo Tech)
2nd Author's Name Kazuyuki Shudo
2nd Author's Affiliation Tokyo Institute of Technology(Tokyo Tech)
Date 2016-03-25
Paper # CPSY2015-151,DC2015-105
Volume (vol) vol.115
Number (no) CPSY-518,DC-519
Page pp.pp.229-234(CPSY), pp.229-234(DC),
#Pages 6
Date of Issue 2016-03-17 (CPSY, DC)