Presentation 2022-03-07
Trace Ablation and Fault Localization per Method Using Machine Learning Models for Automatic Classification of Test Execution Results
Takuma Ikeda, Kozo Okano, Shinpei Ogata, Shin Nakajima,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) The problem to solve automatically classifying the results of test executions is called the test oracle problem. This is one of the most important problems in test automation. In the existing method, we focus on the fact that the execution trace is a sequence of method calls. Our existing method uses Word2vec to obtain the variance vector for each method call information and train the NN model. By performing ablation on a part of the execution trace handled by the existing method, we investigate the information required for the execution trace and the accuracy of the machine learning model. In addition, by deleting the function call information, we estimate the fault location for each method based on the accuracy of the NN model when the fault function information is deleted.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Test Oracle Problem / Supervised Learning / Execution Trace / Ablation / Fault-Localization
Paper # SS2021-44
Date of Issue 2022-02-28 (SS)

Conference Information
Committee SS
Conference Date 2022/3/7(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Online
Topics (in Japanese) (See Japanese page)
Topics (in English) Software Science etc.
Chair Takashi Kobayashi(Tokyo Inst. of Tech.)
Vice Chair Kozo Okano(Shinshu Univ.)
Secretary Kozo Okano(Hiroshima City Univ.)
Assistant Shinpei Ogata(Shinshu Univ.)

Paper Information
Registration To Technical Committee on Software Science
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Trace Ablation and Fault Localization per Method Using Machine Learning Models for Automatic Classification of Test Execution Results
Sub Title (in English)
Keyword(1) Test Oracle Problem
Keyword(2) Supervised Learning
Keyword(3) Execution Trace
Keyword(4) Ablation
Keyword(5) Fault-Localization
1st Author's Name Takuma Ikeda
1st Author's Affiliation Shinshu University(Shinshu Univ.)
2nd Author's Name Kozo Okano
2nd Author's Affiliation Shinshu University(Shinshu Univ.)
3rd Author's Name Shinpei Ogata
3rd Author's Affiliation Shinshu University(Shinshu Univ.)
4th Author's Name Shin Nakajima
4th Author's Affiliation National Institute of Informatics(NII)
Date 2022-03-07
Paper # SS2021-44
Volume (vol) vol.121
Number (no) SS-416
Page pp.pp.13-18(SS),
#Pages 6
Date of Issue 2022-02-28 (SS)