| Presentation | 2023-01-11 A Systematic Review of Source Code Coverage Metrics: Preliminary Results Masayuki Taniguchi, Shinsuke Matsumoto, Shinji Kusumoto, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Software testing plays an essential role in software quality assurance. It helps developers to reveal and remove bugs in software. Developers often use test coverage to measure the sufficiency of tests, find non-tested statements, and localize a faulty statement. Traditional coverages, such as statement and branch coverage, are widely known and used. On the other hand, researchers have proposed various metrics for measuring test coverage of source code. Because such novel coverage metrics are not organized, it is impossible to understand and compare the benefits and limitations of each metric. This paper organizes the characteristics of each coverage metric by surveying a body of 43 papers that propose coverage metrics. The survey results showed that the novel metrics could be divided into two main groups: (1) metrics that improve or complement traditional coverage and (2) metrics that are effective in specific domains, such as concurrent programming. We performed a comparative analysis to identify the characteristics of each metric, such as benefits of use, effective domains, and information needed to measure coverage. Furthermore, we provide a catalog of coverage metrics to help developers and researchers select the best metrics for their context. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Software testing / Test coverage / Coverage metrics / Systematic review |
| Paper # | MSS2022-58,SS2022-43 |
| Date of Issue | 2023-01-03 (MSS, SS) |
| Conference Information | |
| Committee | MSS / SS |
|---|---|
| Conference Date | 2023/1/10(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Atsuo Ozaki(Osaka Inst. of Tech.) / Kozo Okano(Shinshu Univ.) |
| Vice Chair | Shingo Yamaguchi(Yamaguchi Univ.) / Yoshiki Higo(Osaka Univ.) |
| Secretary | Shingo Yamaguchi(Hokkaido Univ.) / Yoshiki Higo(NEC) |
| Assistant | Masato Shirai(Shimane Univ.) / Shinsuke Matsumoto(Osaka Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Mathematical Systems Science and its Applications / Technical Committee on Software Science |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A Systematic Review of Source Code Coverage Metrics: Preliminary Results |
| Sub Title (in English) | |
| Keyword(1) | Software testing |
| Keyword(2) | Test coverage |
| Keyword(3) | Coverage metrics |
| Keyword(4) | Systematic review |
| 1st Author's Name | Masayuki Taniguchi |
| 1st Author's Affiliation | Osaka University(Osaka Univ.) |
| 2nd Author's Name | Shinsuke Matsumoto |
| 2nd Author's Affiliation | Osaka University(Osaka Univ.) |
| 3rd Author's Name | Shinji Kusumoto |
| 3rd Author's Affiliation | Osaka University(Osaka Univ.) |
| Date | 2023-01-11 |
| Paper # | MSS2022-58,SS2022-43 |
| Volume (vol) | vol.122 |
| Number (no) | MSS-329,SS-330 |
| Page | pp.pp.78-83(MSS), pp.78-83(SS), |
| #Pages | 6 |
| Date of Issue | 2023-01-03 (MSS, SS) |