«

»

PACOGEN : Automatic Generation of Pairwise Test Configurations from Feature Models

by Aymeric Hervieu, Benoit Baudry, Arnaud Gotlieb
Abstract:
Feature models are commonly used to specify variability in software product lines. Several tools support feature models for variability management at different steps in the development process. However, tool support for test configuration generation is currently limited. This test generation task consists in systematically selecting a set of configurations that represent a relevant sample of the variability space and that can be used to test the product line. In this paper we propose PACOGEN to analyze feature models and automatically generate a set of configurations that cover all pairwise interactions between features. PACOGEN relies on constraint programming to generate configurations that satisfy all constraints imposed by the feature model and to minimize the set of the tests configuration. This work also proposes an extensive experiment, based on the state-of-the art SPLOT feature models repository, showing that PACOGEN scales over variability spaces with millions of configurations and generates less pairwise-covering test configurations than other existing tools.
Reference:
PACOGEN : Automatic Generation of Pairwise Test Configurations from Feature Models (Aymeric Hervieu, Benoit Baudry, Arnaud Gotlieb), In Proceedings of the International Symposium on Software Reliability Engineering (ISSRE), 2011.
Bibtex Entry:
@inproceedings{Hervieu11,
	Abstract = {Feature models are commonly used to specify variability
    in software product lines. Several tools support feature
    models for variability management at different steps in the
    development process. However, tool support for test configuration
    generation is currently limited. This test generation
    task consists in systematically selecting a set of configurations
    that represent a relevant sample of the variability
    space and that can be used to test the product line. In this
    paper we propose PACOGEN to analyze feature models and
    automatically generate a set of configurations that cover
    all pairwise interactions between features. PACOGEN relies
    on constraint programming to generate configurations
    that satisfy all constraints imposed by the feature model and
    to minimize the set of the tests configuration. This work also
    proposes an extensive experiment, based on the state-of-the
    art SPLOT feature models repository, showing that PACOGEN
    scales over variability spaces with millions of configurations
    and generates less pairwise-covering test configurations
    than other existing tools.
    },
	Address = {Hiroshima, Japan},
	keywords = {SPL, test},
	Author = {Hervieu, Aymeric and Baudry, Benoit and Gotlieb, Arnaud},
	Booktitle = {Proceedings of the International Symposium on Software Reliability Engineering (ISSRE)},
	Month = nov,
	pages = {120-129},
	Title = {PACOGEN : Automatic Generation of Pairwise Test Configurations from Feature Models},
	X-Country = {JP},
	X-International-Audience = {yes},
	X-Language = {EN},
	X-Proceedings = {yes},
	x-abbrv = {ISSRE},
	pages = {120 - 129},
	Year = {2011},
	url={https://hal.inria.fr/hal-00699558/document}}