IEICE Technical Committee Submission System
Conference Paper's Information
Online Proceedings
[Sign in]
... (for ESS/CS/ES/ISS)
Tech. Rep. Archives
... (for ES/CS)
 Go Top Page Go Previous   [Japanese] / [English] 

Paper Abstract and Keywords
Presentation 2011-04-21 16:50
[Special Talk] Optimizing systems with more reliable performance metrics
Takayuki Osogami (IBM Research - Tokyo)
Abstract (in Japanese) (See Japanese page) 
(in English) The system of measuring the performance of a Web system using a workload generator can be modeled as a closed interactive system. In such a system, the throughput and the mean response time are related by the response time law. However, we find that a measured throughput and a corresponding measured mean response time can have significantly different accuracy. As a result, one metric may be more reliable than the other to identify the better of two given configurations of a Web system, which is an important problem that appears frequently in practice. Using simulation, we derive rules of thumb that characterize when throughput is more reliable than mean response time. Also, we explain these rules of thumb analytically. Specifically, we refine the response time law using the central limit theorem and formally define the asymptotic reliability of an estimator of a metric. Using these analytical frameworks, we provide insights into when and why one metric is more reliable than the other.
Keyword (in Japanese) (See Japanese page) 
(in English) Response time law / Central limit theorem / Closed interactive system / Web system / Simulation / Accuracy / Mean response time / Throughput  
Reference Info. IEICE Tech. Rep., vol. 111, no. 8, NS2011-7, pp. 37-42, April 2011.
Paper # NS2011-7 
Date of Issue 2011-04-14 (NS) 
ISSN Print edition: ISSN 0913-5685  Online edition: ISSN 2432-6380

Conference Information
Committee NS  
Conference Date 2011-04-21 - 2011-04-22 
Place (in Japanese) (See Japanese page) 
Place (in English) Fukui University 
Topics (in Japanese) (See Japanese page) 
Topics (in English) Traffic, Network evaluation, Performance, Resource Management/Control, Traffic Engineering 
Paper Information
Registration To NS 
Conference Code 2011-04-NS 
Language Japanese 
Title (in Japanese) (See Japanese page) 
Sub Title (in Japanese) (See Japanese page) 
Title (in English) Optimizing systems with more reliable performance metrics 
Sub Title (in English)  
Keyword(1) Response time law  
Keyword(2) Central limit theorem  
Keyword(3) Closed interactive system  
Keyword(4) Web system  
Keyword(5) Simulation  
Keyword(6) Accuracy  
Keyword(7) Mean response time  
Keyword(8) Throughput  
1st Author's Name Takayuki Osogami  
1st Author's Affiliation IBM Research - Tokyo (IBM Research - Tokyo)
2nd Author's Name  
2nd Author's Affiliation ()
3rd Author's Name  
3rd Author's Affiliation ()
4th Author's Name  
4th Author's Affiliation ()
5th Author's Name  
5th Author's Affiliation ()
6th Author's Name  
6th Author's Affiliation ()
7th Author's Name  
7th Author's Affiliation ()
8th Author's Name  
8th Author's Affiliation ()
9th Author's Name  
9th Author's Affiliation ()
10th Author's Name  
10th Author's Affiliation ()
11th Author's Name  
11th Author's Affiliation ()
12th Author's Name  
12th Author's Affiliation ()
13th Author's Name  
13th Author's Affiliation ()
14th Author's Name  
14th Author's Affiliation ()
15th Author's Name  
15th Author's Affiliation ()
16th Author's Name  
16th Author's Affiliation ()
17th Author's Name  
17th Author's Affiliation ()
18th Author's Name  
18th Author's Affiliation ()
19th Author's Name  
19th Author's Affiliation ()
20th Author's Name  
20th Author's Affiliation ()
Date Time 2011-04-21 16:50:00 
Presentation Time 45 
Registration for NS 
Paper # IEICE-NS2011-7 
Volume (vol) IEICE-111 
Number (no) no.8 
Page pp.37-42 
#Pages IEICE-6 
Date of Issue IEICE-NS-2011-04-14 

[Return to Top Page]

[Return to IEICE Web Page]

The Institute of Electronics, Information and Communication Engineers (IEICE), Japan