针对在测试资源紧张的情况下所面临的不同测试技术中测试方法选择问题,阐明了对基于结构覆盖和基于状态识别的测试生成技术进行实验评估的必要性,以10个有限状态机(finite state machine,FSM)应用实例为实验对象,从测试开销和错误覆盖能力两方面对这两种技术进行了实证研究,为FSM一致性测试中这两种技术的选择应用提供了经验性的参考建议。
In finite state machine (FSM) conformance testing, there are two widely used test generation techniques which are based on structure coverage and state identification respectively. Under the condition of scarce test resources, we often face the problem of weighing selection of different test methods. To the best of our knowledge, there is no comprehensive comparative study of these two test techniques so far. This paper presents the necessity of experimental evaluation of the two test methods, and conducts experiments based on 10 FSM empirical cases. The performance is evaluated in terms of test cost and fault coverage capability, so as to provide empirical suggestions for the selection and application of these two techniques in FSM conformance testing.
[1] 刘攀, 缪淮扣, 曾红卫, 等. 基于FSM的测试理论、方法及评估[J]. 计算机学报, 2011, 34(6):965-984. Liu P, Miao H K, Zeng H W, et al. FSM-based testing:theory, method and evaluation[J]. Chinese Journal of Computers, 2011, 34(6):965-984. (in Chinese)