Arnaud Gotlieb,   habilitated (12 Dec. 2011)                                                   
        working at SIMULA RESEARCH LAB.

     Certus Software Validation&Verification Center  Lysaker, Norway
     https://www.simula.no/people/arnaud
    ----------------------------------------------------------------

  • Simula Research Laboratory, P.O. Box 134 - 1325 Lysaker, Norway                                                                                   
  • Email : arnaud@simula.no


AG




Research interests
    My research interests are centered around Software Testing and Artificial Intelligence (AI). In particular, I’m interested in developing techniques and tools which combine  AI techniques such as Constraint Programming and Machine Learning to test safety- or business- critical software-systems. My work focuses on automatic test data generation, test suite optimisation and prioritisation, test execution scheduling. In the late 90s, I proposed Constraint-Based Testing as a general paradigm to automatically generate test cases by using constraint solving techniques. Recently, I have been working on using Reinforcement Learning for test execution scheduling and program understanding. 


Tools (with my hands-on)


Some presentations
      Automatic Test Data Generation with Constraint Logic Programming -- Colorado State University-  CS Dept. , Nov. 2003
      Testing Programs with Symmetry -- CASSIS 2004 workshop, Marseille, France, Mar. 2004 (Invited talk)
      Correct handling of floating-point computations in symbolic execution  --  V3F seminar, Paris, Jun. 2004
      INKA: Ten years after the first idea -- CEA Seminar -- Saclay, May. 2006
      TCAS software verification using Constraint Programming -- CT for Air Traffic Control workshop - Dec. 2008, INO Eurocae, Bretigny sur Orge,France
      An overview of Constraint-Based Testing -- Uppsala's University seminar (invited) -- May 2010
      A video of my habilitation defense  -- University of Rennes -- 12 Dec. 2011
      CP also meets Software Testing -- CP meets CAV workshop, Turunc, Turkey -- Jun. 2012
      Constraint-Based Reachability -- Infinity Workshop (Invited presentation) - 18th Int. Symp. on Formal Methods -- Aug. 2012
      Dagsthul Seminar on "Symbolic methods in software testing" - Jan. 2013
      FLOWER: optimal test suite reduction as a network maximum flow - 24 Jul. 2014 - ISSTA, San José, CA, USA
      Symbolic Path-Oriented Test Data Generation for Floating-Point Programs - Dagsthul Seminar on "Symbolic Execution and Constraint Solving" - Oct. 2014
      Global Constraints for Software Testing Applications - CPAIOR 2015 Master Class, Barcelona, Spain - May 2015
      Constraint-Based Testing: An Emerging Trend in Software Testing - In PROLE 2016, Salamanca, Spain, 14-16 Sep. 2016.
      Constraint-Based Test Suite Optimization -  (ICTSS'16), October 17-19, Graz, Austria., 2016.
      Software Testing Applications with Constraint Optimization - In SICS, Smart Programming Day, Nov. 29th, Stockholm, Sweden., 2016.
      Intelligent Test Optimization – TAROT Summer School, May. 2017, Naples, Italy.
      Testing Robotic Systems: A New Battlefield! – In CNRS National Days of GDR-GPL, Jun. 2017, Montpellier, France. 
      Time-aware Test Case Execution Scheduling for Cyber-Physical Systems - In CP'17, Principles of Constraint Programming, Aug., Melbourne, Australia, 2017.
      Artificial Intelligence in Software Testing: An Overview –  10ème Comité Francais du Test Logiciel, Apr. 10th, 2018, Paris, France.

Publications

On a personal page On  INRIA's HAL On Researchgate On DBLP On google scholar

Project participation while I was at Inria (OLD):

Research projects
 Research projects
INKA project  funded by the RNTL (2001-2004)
Building an automatic test data generator for C/C++, based on constraint solving technology
 CAT / U3CAT project funded by the RNTL (2005-2012)
Building a C Analysis Toolbox. Exploring constraint-based analysis for C pointer programs
CASTLES project  funded by the RNTL (2003-2006)
Design of static analysis and tests for secure embedded systems
CAVERN project funded by ANR  (2008-2011)
Constraints and Abstractions for program VERificatioN 
V3F project  funded by th ACI Sécurité Inf. (2004-2007)
Validation & Verification of programs with floating-point numbers calculus 		 GENETTA project funded by Brittany Region (2007-2010)
 Automatic statistical test data generation for embedded Java
CHANNEL project  funded by PAI ALLIANCE (2008-2009)
 Automatic test data generation for security problems.
In collaboration with Andy King from the University of Kent. 		Industrial PhD supervision - A. Hervieu - KEREVAL, Thorigné-Fouillard, France (2010-2013)

Project participation while I am at Simula Research Laboratory:
CERTUS SFI  funded by RCN (2011-2019)
A 8-year large initiative on Software V&V in Norway		 Industrial PhD supervision -- M. Mossige -
ABB Robotics, Norway (2012-2015)
CERTISKATT funded by PHC France-Norway (2014) FORNY-TITAN funded by RCN (2014-2015)
T-LARGO funded by RCN FRINATEK/IKTPLUSS (2018-2022)
Testing of Learning Robots		 VIVA funded by RCN AURORA (2018)
H2020 LEIT-ICT26  AI4EU  (2019-2022)
Building The European AI On-Demad Platform		 TSAR funded by RCN IKTPLUSS Reducing Digital Vulnerabilities


PhD Students 
Tristan Denmat       
Defense on 5 June 2008		 Matthieu Petit                 
Defense on 4 July 2008		 Florence Charreteur           
Defense on 9 March 2010
Aymeric Hervieu
Defense on 9 Dec. 2013
 Mickael Delahaye 
Defense on 26 Oct. 2011 		Nadjib Lazaar
Defense on 5 Dec. 2011
Shuai Wang
Defense on 20 Apr. 2015 		Erik Rogstad                
Defense on 29 Jan. 2016		 Stefano Di Alesio
Defense on 19 Mar. 2015
Morten Mossige  (ABB Robotics)     Defense on 26 Aug. 2015 Carlo Ieva (SIMULA - Univ. of Montpellier)
Defense on 23 Nov. 2018
 Mathieu Collet (SIMULA, ABB Robotics, Univ. of Stavanger) - Since 2017 Helge Spieker (SIMULA - University of Oslo) - Since 2017 Mohit Kumar Ahuja (SIMULA - University of Oslo) - Since 2018
Pierre Bernabé (SIMULA - Université de Bourgogne Franche-Comté) - Since 2019

Teaching Resources

Professional Activities

2020
ISSTA'20           (PC member)
AAAI-20            (PC member)
ICST'20             (PC member)
ICSE-SEIP'20     (PC member)

2019
AI Test 2019    (Program co-chair) -- 1st IEEE Int. Conf. On Artificial Intelligence Testing, San Francisco, CA, USA, Apr. 2019
CP'19               (Track co-chair)  --  25th Int. Conf. on Principles and Practice of Constraint Programming, Stamford, CT, USA, Sep. 2019 
IJCAI'19          (PC member)      --  Int. Joint Conf. on Artificial Intelligence, Macao, China, Aug. 2019
QRS'19             (PC member)      --  19th IEEE Int. Conf. on Software Quality, Reliability and Security, Sofia, Bulgaria Jul. 2019
DSO'19             (PC member)      --  Data Science Meets Optimization Workshop, an IJCAI 2019 Workshop, Macao, China, Aug. 2019
IFIP-ICTSS'19  (PC member)      --  31th IFIP Int. Conf. on Testing Software and Systems, Paris, France Oct. 2019
LOPSTR'19        (PC member)      --   25th Int. Symp. on Logic-Based Program Synthesis and Transformation, Porto, Portugal, Oct. 2019

2018
CP'18               (Track co-chair)  --  24th Int. Conf. on Principles and Practice of Constraint Programming, Lille, France, Aug. 2018
QRS'18             (PC member)      --  18th IEEE Int. Conf. on Software Quality, Reliability and Security, Lisbon, Portugal, Jul. 2018
IJCAI-ECAI'18  (PC member)      --  Int. Joint Conf. on Artificial Intelligence, Stockholm, Sweden, July 2018
TAP'18              (PC member)      --   12th  Int. Conf. on Tests and Proofs, Toulouse, France, Jun. 2018
ICTAI'18           (PC member)      --  30th Int. Conf. on Tools with Artificial Intelligence, Volos, Greece, Nov. 2018  
IFIP-ICTSS'18   (PC member)      --  30th IFIP Int. Conf. on Testing Software and Systems, Cadiz, Spain, Oct. 2018

2017
CP'17                (Track co-chair)  --  23rd Int. Conf. on Principles and Practice of Constraint Programming, Melbourne, Australia Sep. 2017
QRS'17             (Workshop chair, PC member)  --  IEEE Int. Conf. on Software Quality, Reliability and Security, Prague, Czech, Jul. 2017
IJCAI'17           (PC member)      --  Int. Joint Conf. on Artificial Intelligence, Melbourne, Australia, Aug. 2017
TAP'17              (PC member)      --   11th  Int. Conf. on Tests and Proofs, Marburg, Germany, Jul. 2017
ICTAI'17           (PC member)      --  29th Int. Conf. on Tools with Artificial Intelligence, Boston, MA, USA, Nov. 2017  
IFIP-ICTSS'17   (PC member)      --  29th IFIP Int. Conf. on Testing Software and Systems, St Petersburg, Oct. 2017
MET'17              (PC member)     --   2nd Int. Workshop on Metamorphic Testing, Buenos Aires, Argentine, May 2017
CSTVA'17          (Steering Com., Co-Organizer)  -  Workshop on Constraint Solvers in Testing, Verification and Analysis, Melbourne, 2017

2016
CP'16                (Track co-chair)  --  22st Int. Conference on Principles and Practice of Constraint Programming, Toulouse, France, Sep. 2016
COMPSAC'16   (PC member)     -- 40th IEEE Annual Int. Computer Software & Applications Conference
MET'16             (PC member)     --  First International Workshop on Metamorphic Testing
iFMCloud'16        (PC member)     --  First International Workshop on Formal Methods for and on the Cloud
TAP'16              (PC member)     --   11th  Int. Conf. on Tests and Proofs

2015
CP'15                (PC member)  --  21st Int. Conference on Principles and Practice of Constraint Programming, Cork, Ireland, 31 Aug. 4 Sep. 2015
IJCAI'15           (PC member)  --  Intl Joint Conf. on Artificial Intelligence, Bueno Aires, Argentine, 25-31 July 2015
ICST'15             (PC member, PhD symposium co-chair)  -- IEEE Intl Conf. on Soft. Testing, Verif. and Valid., Graz, Austria, 13-17 April 2015
FM'15                (Finance co-chair)  --  20th International Symposium on Formal Methods, Oslo, Norway 22-26 June, 2015
TAP'15              (PC member)         --   Int. Conf. on Tests and Proofs, L'Aquila, Italy, July 20-24, 2015
LOPSTR'15        (PC member)      --   25th Int. Symp. on Logic-Based Program Synthesis and Transformation, Siena, Italy, 13-15 July 2015
CSTVA'15         (Program co-chair) --   6th  Workshop on Constraints in Software Testing, Verification and Analysis, India, June, 2014


2014
ICSE'14 SEIP     (Program co-chair)  -- 36th Int. Conf. on Software Engineering, SEIP (Software Engineering In Practice) Track, India, Jun. 2014
ICST'14              (PC member)         --   7th IEEE Int. Conf. on Software Testing, Verification and Validation, Cleveland, Ohio, USA, Mar. Apr. 2014
COMPSAC'14    (PC member)       -- 38th IEEE Annual Int. Computer Software & Applications Conference, Västeras, Sweden, July 21-25, 2014
ISSRE'14             (PC member)       --   25th IEEE International Symposium on Software Reliability Engineering, Naples, Italy, 4-6 Nov. 2014
LOPSTR'14         (PC member)                 --  University of Kent, Canterbury, UK, September 8-11, 2014
TAP'14                (PC member)                 --   Int. Conf. on Tests and Proofs, York, UK, July 24-25, 2014
HCVS'14             (PC member)                 --   Workshop on Horn Clauses for Verification and Synthesis, Vienna, Austria, July 17, 2014
CSTVA'14           (PC member)                 --   6th  Workshop on Constraints in Software Testing, Verification and Analysis, India, June, 2014

2013
QSIC'13           (Program co-chair)  --  13th International Conference on Quality Software  Nanjing University, China, Jul 2013
COMPSAC'13  (PC member)          --  37th IEEE Annual International Computer Software & Applications Conference, Kyoto, Japan, July 22-26, 2013
ISSRE'13             (PC member)                 --   24th IEEE International Symposium on Software Reliability Engineering, Pasadena, CA, USA, Nov. 2013
TAP'13             (PC member)          --   Int. Conf. on Tests and Proofs, Budapest, Hungary, June 18-19, 2013
ICST'13            (PC member)          --   6th IEEE International Conference on Software Testing, Verification and Validation, Luxembourg, Mar. 2013,
CSTVA'13        (PC member)          --   5th Workshop on Constraints in Software Testing, Verification and Analysis
ICSE'13 SEIP   (PC member)          --  35th IEEE International Conference on Software Engineering, SEIP Track, San Francisco, Jun. 2013
CP'13 Application track (PC member)  --  19th Int. Conf. on Principles and Practice of Constraint Programming, Uppsala, Sweden, Sep. 16-20, 2013

2012
ISSRE'12 (PC member) ICST'12 (Workshop co-chair) CSTVA'12 (PC member)  JFPC'12 (PC member)  TAP'12 (PC member) QSIC'12 (PC member) 

2011
CSTVA'11 (Organizer), VAST'11 (PC member), QSIC'11 (PC member) , TAP'11 (PC member) 
2010
CSTVA'10 (Organizer), ICST'10 (PC member), TAP'10 (PC member), QSIC'10 (PC member), JFPC'10 (PC member) 
2009
TAP'09 (PC member), QSIC'09 (PC member), ICST'09 (PC member), JFPC'09 (PC member)
2008
WLPE'08 (PC member),QSIC'08 (PC member), ICST'08 (PC member), JFPC'08 (PC member)
2007
RT'07 (PC member), STEV'07 (PC member), QSIC'07 (PC member),JFPC'07 (PC member)
2006
CSTVA'06 (Organizer), QSIC'06 (PC member), JFPC'06 (PC member)
2005
JFPC'05 (PC member) -- Journées Françaises de Programmation par Contraintes
2004
ICLP'04 (Publicity chair), ISSRE'04 (PC member, Publicity chair) , JFPC'04 (PC member)