Welcome to Evently

Lorem ipsum proin gravida nibh vel veali quetean sollic lorem quis bibendum nibh vel velit.


Simply enter your keyword and we will help you find what you need.

What are you looking for?

Paper ID 5646

Paper Information

Structural Coverage of LTL Requirements for Learning-based Testing

Paper ID: 5646

Hafiz Abdul Quddus

Muddassar Azam Sindhu


Learning-based testing (LBT) is an innovative variant of black-box testing in which test cases are derived by making use of automaton learning and model checking algorithms along with providing Linear Temporal Logic (LTL) requirements of the System under Test (SUT). There is a scarcity of test coverage metrics for black-box testing in general and LBT in particular. Structural coverage of an LTL requirement is a mechanism that gauges how well a test suite has exercised the structure of the LTL formula. In contrast to the code-driven or model-driven coverage metrics, this type of coverage provides implementation-independent coverage achieved corresponding to an LTL requirement. This has been defined and used in the literature for black-box testing, however, not for LBT. This paper analyzes and implements the structural coverage criteria for the LTL requirements for the evaluation of the LBT-generated test suite. We evaluate the structural coverage metrics using the Cruise Control System (CCS) and the ATM systems. The results show that the LBT test suite provides complete structural coverage of the safety LTL requirements in terms of Requirement coverage (RC), Antecedent coverage (AC), and Unique First Cause Coverage (UFCC). In the case of liveness LTL requirements, relatively less structural coverage is achieved by the LBT tests possibly because of the involvement of loops in tests.