120 likes | 135 Views
WP 4 : Testing Tools and Methodologies. Status Report ETICS All-Hands – 2 1 November 2007 Éva Takács (4D SOFT). Staffing and Resources. István Forgács Tasks: Coordination Etics, Diligent Eva Takács – full time Etics Tasks: Implementation of plugins
E N D
WP4: Testing Tools and Methodologies Status Report ETICS All-Hands – 21November 2007 Éva Takács (4D SOFT)
Staffing and Resources • István Forgács • Tasks: • Coordination Etics, Diligent • Eva Takács – full time Etics Tasks: • Implementation of plugins • Implementation and testing of installation modules • Diligent system testing – modelling in ETICS • Andor Dirner – 30% Etics, 60% Diligent, 10% system administration • Tasks: • Implementation and testing of installation modules • Diligent testing ETICS 3rd All-Hands Meeting - University of Wisconsin, Madison - 23-25/05/2007
Deliverables Status • ETICS-D4.3-Distributed_testing updated version of the draft sent to EU in M18 • Content: • Distributed testing in ETICS („co-scheduling” functionality) • A chapter about Condor/Metronome, how it works, how it is used inside ETICS to submit test jobs and so on • Test and metrics plugin framework • Test and metrics plugins • Metrics and their tools support in ETICS • Case study: Diligent system testing using ETICS • Installation modules • Status: • Internal review version sent on 14 November • Waiting for the contribution about Condor/Metronome ETICS 3rd All-Hands Meeting - University of Wisconsin, Madison - 23-25/05/2007
Major Tasks Performed • Implementation of new and customisation of existing test and metrics plugins • Integrating the plugins better in ETICS by using properties, creating summaries in ETICS reports • Implementation of the installation modules (tomcat, mysql) • Modelling and ETICS environment for Diligent system testing
Test and Metrics plugins • JCnnPlugin.py (javaccn) • JUnitPlugin.py (junit) • JUnitreportsPlugin.py • JUnitemmaPlugin.py (emma coverage for junit) • JCoberturaPlugin.py (cobertura coverage for junit) • JDependPlugin.py (jdepend – dependency analyser) • JPmdPlugin.py (pmd – source code quality) • JFindbugsPlugin.py (findbugs – bug pattern analysis) • JRat.py (java profiler) • CFlawfinderPlugin.py (flawfinder - static analyser for C/C++) • CPyPHPRatsPlugin.py (Rats – static analyser for C/C++, Perl, python, php) ETICS 3rd All-Hands Meeting - University of Wisconsin, Madison - 23-25/05/2007
Installation modules • Redesigning, reimplementing and modelling a testing environment for the tomcat installation module • Modelling a testing environment and implementing the mysql install module
Modelling an ETICS environment for Diligent system testing • Remote regression testing using the Diligent system testing environment as a private resource • Applying of plugins for core Diligent services grouped in org.diligentproject.*.*.*SERVICEARCHIVE components. Applied plugins: JFindbugsPlugin, JDependPlugin in production JPmdPlugin, JccnPlugin soon in production
Issues • Plugins: • Putting them in production is still pending • Validating them through Diligent testing – four plugins have been validated, customised, used intensively • Validating the plugins for remote builds is pending. This task can be done when the plugins will be part of the client • Implementation of new plugins after reviewing what we have • Valgrind – a C profiler is under examination • PushToTest’s TestMaker a webservice testing tool is under examination
Issues • Installation modules • Putting them in „production” • Registering them in a dedicated project or somewhere in ETICS??? • Registering in the externals and being set up as dependency for individual modules
Workplan for the next quarter • Supporting Diligent system testing using, improve the modelled environment if it is the case • Validation of plugins (remote builds validation is missing) and installation modules • Implementation of the required new modules after having a look what we have ETICS 3rd All-Hands Meeting - University of Wisconsin, Madison - 23-25/05/2007
Metrics • Nr of plugins: 11 • Nr of installation modules: 2 ETICS 3rd All-Hands Meeting - University of Wisconsin, Madison - 23-25/05/2007
Conclusion Important issues: • Putting tthe plugins in production • If it is the case improve Diligent-ETICS integration • (Strong requirements for the review)