Presentation | 2018-07-30 Analysis of commercial cloud workload and study on how to apply cache methods Kazuichi Oe, Kazutaka Ogihara, Takeo Honda, |
---|---|
PDF Download Page | PDF download Page Link |
Abstract(in Japanese) | (See Japanese page) |
Abstract(in English) | We analyzed some storage workloads of the FUJITSU K5 cloud service, which was built using theOpenStack platform, to clarify how to handle these workloads effectively. We retrieved these storage workloads andanalyzed them from the viwe point of both temporal and spatial access locality. For temporal access locality, weclassified these workloads as two input/output (IO) access patterns. One was that the number of IO accesses washigh only for a specific time and the other was that the number of IO accesses was almost stable. For both temporaland spatial access locality, we found that almost all workloads included IO concentrations. Such concentrationsare aggregations of IO accesses and appear in narrow regions of a storage volume and continue for periods of upto an hour. Therefore, we studied how to apply cache methods by using a cache simulator. The cache hit ratiosvaried with workload, but almost half of the workloads had low cache hit ratios because they included few page-levelregularities. Automated tiered storage with fast memory and slow flash storage (ATSMF), which was we proposedin our previous study, can handle IO concentration effectively because its migration algorithm found the entire areaof IO concentration and migrated it from slow storage to fast storage if the migration improves user’s performance. We predict that the cache hit ratios of ATSMF will be much higher than the half workloads of the Least RecentlyUsed and Adaptive Replacement Cache algorithms. Therefore, we should develop a technique that combines ATSMFand traditional caching. From the results of temporal access locality, we can a share fast storage area among severalworkloads when these workloads have different times when the number of IO accesses is high. Moreover, we shouldpreferentially allocate a fast storage area to IO concentrated workloads, which accounts for only 1.2% of the totalworkloads, because these workloads include more than half of all IO accesses. |
Keyword(in Japanese) | (See Japanese page) |
Keyword(in English) | Cloud workloadanalysiscachingLRUARCIO concentrationATSMF |
Paper # | CPSY2018-14 |
Date of Issue | 2018-07-23 (CPSY) |
Conference Information | |
Committee | CPSY / DC / IPSJ-ARC |
---|---|
Conference Date | 2018/7/30(3days) |
Place (in Japanese) | (See Japanese page) |
Place (in English) | Kumamoto City International Center |
Topics (in Japanese) | (See Japanese page) |
Topics (in English) | Parallel, Distributed and Cooperative Processing Systems and Dependable Computing |
Chair | Koji Nakano(Hiroshima Univ.) / Satoshi Fukumoto(Tokyo Metropolitan Univ.) / Masahiro Goshima(NII) |
Vice Chair | Hidetsugu Irie(Univ. of Tokyo) / Takashi Miyoshi(Fujitsu) / Hiroshi Takahashi(Ehime Univ.) |
Secretary | Hidetsugu Irie(Utsunomiya Univ.) / Takashi Miyoshi(Hokkaido Univ.) / Hiroshi Takahashi(Tokyo Inst. of Tech.) / (Nihon Univ.) |
Assistant | Yasuaki Ito(Hiroshima Univ.) / Tomoaki Tsumura(Nagoya Inst. of Tech.) |
Paper Information | |
Registration To | Technical Committee on Computer Systems / Technical Committee on Dependable Computing / Special Interest Group on System Architecture |
---|---|
Language | ENG |
Title (in Japanese) | (See Japanese page) |
Sub Title (in Japanese) | (See Japanese page) |
Title (in English) | Analysis of commercial cloud workload and study on how to apply cache methods |
Sub Title (in English) | |
Keyword(1) | Cloud workloadanalysiscachingLRUARCIO concentrationATSMF |
1st Author's Name | Kazuichi Oe |
1st Author's Affiliation | Fujitsu Laboratories LTD.(FLABO) |
2nd Author's Name | Kazutaka Ogihara |
2nd Author's Affiliation | Fujitsu Laboratories LTD.(FLABO) |
3rd Author's Name | Takeo Honda |
3rd Author's Affiliation | FST(FST) |
Date | 2018-07-30 |
Paper # | CPSY2018-14 |
Volume (vol) | vol.118 |
Number (no) | CPSY-165 |
Page | pp.pp.7-12(CPSY), |
#Pages | 6 |
Date of Issue | 2018-07-23 (CPSY) |