Estimating and Amplifying an OSS Web Application's Test-Set based on Test-Conditions extracted from Capture Data

Abstract

This paper proposes a method for evaluating comprehensiveness of a test set attached with an OSS web applicaiton based on uses of the OSS web application in operation time, and a interactive method for amplifying the comprehensiveness. In the OSS web application with various functions, no-tested uses of the functions would occure in operation time. Using HTTP packet capture and replay tool, the uses of the web application in operation time can be replayed. However, it is still a difficult task for a normal tester to find the uses which are effective for amplifying the comprehensiveness of the test set from big capture data. In our approach, then, by extracting test conditions corresponding to uses of an OSS web application from capture data in test and operation time, and by aggregating/visualizing the test conditions as compact table, it let a normal tester effectively find and understand the uses which has never been tested. And by auto-generating replay scripts corresponded to some test conditions choiced by the tester, the comprehensiveness of the test set can be improved gradually. A case study results, which uses an OSS web application called Redmine and its capture data gathered for 48 days in operation time, shows usefulness of our proposed method.