1 / 12

Softeam’s testing process: a story

Softeam’s testing process: a story. Cyril Ballagny, SOFTEAM | ModelioSoft The 13th CREST Open Workshop London, England 13th of May 2011. Introduction to Softeam. A French SME (about 230 people) More than 20 years of expertise in OO development and Modeling

louie
Download Presentation

Softeam’s testing process: a story

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Softeam’s testing process: a story Cyril Ballagny, SOFTEAM | ModelioSoft The 13th CREST Open Workshop London, England 13th of May 2011 www.modeliosoft.com

  2. Introduction to Softeam A French SME (about 230 people) More than 20 years of expertise in OO development and Modeling Consulting, Training, Engineering activities Software Publishing: Modelio and Objecteering Strong R&D efforts since its creation Innovator since 1989 (Modeling, MDA, UML) Heavily involved in R&D cooperative projects (FITTEST, MADES, ENOSYS…) Participates in the OMG standardization efforts since 1996 (UML profiles, SOAML, SysML…) 2 www.modeliosoft.com

  3. Introduction to Modelio A CASE tool For UML modeling For MDA application For Code generation (Java, C#, C++…) For documentation generation (HTML, word…) For team work and project sharing And much more (BPMN, SysML, SOAML…)! 3 www.modeliosoft.com

  4. Modelio development process Agile development with bootstrapping and continuous integration 20 people involved 1 million LOC (C++/Java) A new release every 6 months 4 www.modeliosoft.com

  5. Modelio testing process (1) Code quality management with Sonar: about 500 coding rules Continuous integration with Hudson: report broken build (inconsistent API, missing source in the repository…) Bug tracking with Mantis: everyone from the team can report bugs Specification of test plans with Test Link (natural language): about 2000 procedures Bootstrapping: Modelio is validated by developers 5 www.modeliosoft.com

  6. Modelio testing process (2) A test case is either A Mantis bug (bug 2123, bug 9478…) A menu item (create, delete, mask…) A diagram artifact (state, region, activity…) Most test cases are UI-based and derived from general scenarios (e.g. apply command “xxx” to element in {a,b,c…} ) Test case execution is externalized to Eastern Europe 6 www.modeliosoft.com

  7. Our issues Specification often changes Writing operational test specification is too time consuming compared with natural language specification Test code must be tested too Mix of languages (C++/Java/Jython) No tools for testing HMI combining Java and C++ 7 www.modeliosoft.com

  8. Our expectations (1) Reduce over-testing Detect overlapping sections of test cases Recombine sections to constitute smaller test cases with greater coverage Apply regression tests only on parts of the system that have changed Reduce under-testing Detect system parts that are not covered by the test cases Detect sequences of interactions allowed by the GUI that have not been tested 8 www.modeliosoft.com

  9. Our expectations (2) Reduce Time-To-Market Generate test cases instead of specifying them Prioritize: Identify the most used features Identify the most frequent bugs 9 www.modeliosoft.com

  10. To sum up We would like a scalable and pragmatic approach whose ROI has been demonstrated 10 www.modeliosoft.com

  11. Thank you for your attention! 11 Andrey Sadovykh SOFTEAM | ModelioSoft andrey.sadovykh@softeam.fr SOFTEAM R&D Web Site: http://rd.softeam.com ModelioSoft Web Site: http://www.modeliosoft.com www.modeliosoft.com

  12. M o d e l i n g s o l u t i o n s.

More Related