EEMCS

Home > Publications
Home University of Twente
Education
Research
Prospective Students
Jobs
Publications
Intranet (internal)
 
 Nederlands
 Contact
 Search
 Organisation

EEMCS EPrints Service


15837 Interpreting a Successful Testing Process: Risk and Actual Coverage
Home Policy Brochure Browse Search User Area Contact Help

Stoelinga, M.I.A. and Timmer, M. (2009) Interpreting a Successful Testing Process: Risk and Actual Coverage. In: Proceedings of the Third IEEE International Symposium on Theoretical Aspects of Software Engineering, 29 Jul - 31 Jul 2009, Tianjin, China. pp. 251-258. IEEE Computer Society. ISBN 978-0-7695-3757-3

Full text available as:

PDF

223 Kb

Official URL: http://dx.doi.org/10.1109/TASE.2009.26

Exported to Metis

Abstract

Testing is inherently incomplete; no test suite will ever be able to test all possible usage scenarios of a system. It is therefore vital to assess the implication of a system passing a test suite. This paper quantifies that implication by means of two distinct, but related, measures: the risk quantifies the confidence in a system after it passes a test suite, i.e., the number of faults still expected to be present (weighted by their severity); the actual coverage quantifies the extent to which faults have been shown absent, i.e., the fraction of possible faults that has been covered. We provide evaluation algorithms that calculate these metrics for a given test suite, as well as optimisation algorithms that yield the best test suite for a given optimisation criterion.

Item Type:Conference or Workshop Paper (Full Paper, Talk)
Research Group:EWI-FMT: Formal Methods and Tools
Research Program:CTIT-DSN: Dependable Systems and Networks
Research Project:SYRUP: SYmbolic RedUction of Probabilistic Models, MOQS: Modeling and Analysis of QoS of Component-Based Designs, Quasimodo: Quantitative System Properties in Model-Driven-Design of Embedded Systems
Uncontrolled Keywords:Coverage, Formal testing, Probabilistic, Risk
ID Code:15837
Status:Published
Deposited On:26 August 2009
Refereed:Yes
International:Yes
More Information:statisticsmetis

Export this item as:

To correct this item please ask your editor

Repository Staff Only: edit this item