| Presentation | 2011-04-21 Optimizing systems with more reliable performance metrics Takayuki OSOGAMI, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | The system of measuring the performance of a Web system using a workload generator can be modeled as a closed interactive system. In such a system, the throughput and the mean response time are related by the response time law. However, we find that a measured throughput and a corresponding measured mean response time can have significantly different accuracy. As a result, one metric may be more reliable than the other to identify the better of two given configurations of a Web system, which is an important problem that appears frequently in practice. Using simulation, we derive rules of thumb that characterize when throughput is more reliable than mean response time. Also, we explain these rules of thumb analytically. Specifically, we refine the response time law using the central limit theorem and formally define the asymptotic reliability of an estimator of a metric. Using these analytical frameworks, we provide insights into when and why one metric is more reliable than the other. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Response time law, / Interactive response time law / Central limit theorem / Closed interactive system / Web system / Measurement / Simulation / Accuracy / Mean response time / Throughput |
| Paper # | NS2011-7 |
| Date of Issue |
| Conference Information | |
| Committee | NS |
|---|---|
| Conference Date | 2011/4/14(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Network Systems(NS) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Optimizing systems with more reliable performance metrics |
| Sub Title (in English) | |
| Keyword(1) | Response time law, |
| Keyword(2) | Interactive response time law |
| Keyword(3) | Central limit theorem |
| Keyword(4) | Closed interactive system |
| Keyword(5) | Web system |
| Keyword(6) | Measurement |
| Keyword(7) | Simulation |
| Keyword(8) | Accuracy |
| Keyword(9) | Mean response time |
| Keyword(10) | Throughput |
| 1st Author's Name | Takayuki OSOGAMI |
| 1st Author's Affiliation | IBM Research-Tokyo() |
| Date | 2011-04-21 |
| Paper # | NS2011-7 |
| Volume (vol) | vol.111 |
| Number (no) | 8 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |