1 / 23

Multi-Environment Software Testing on the Grid

Alexandre Duarte Gustavo Wagner Francisco Brasileiro Walfredo Cirne. Multi-Environment Software Testing on the Grid. Universidade Federal de Campina Grande - Brasil. There are applications with very time consuming test phases Rothermel, Untch, and Chu (7 weeks) Smart Alarms (36 hours)

anja
Download Presentation

Multi-Environment Software Testing on the Grid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Alexandre Duarte Gustavo Wagner Francisco Brasileiro Walfredo Cirne Multi-Environment Software Testing on the Grid Universidade Federal de Campina Grande - Brasil

  2. ISSTA 2006 There are applications with very time consuming test phases Rothermel, Untch, and Chu (7 weeks) Smart Alarms (36 hours) Configuration mistakes in software installation are the major reasons for computer system errors Pointed by Brown and Patterson in 2001 Observed in two surveys we have conducted with the grid community along the last years Motivation

  3. ISSTA 2006 Motivation • Grid applications are supposed to be correctly executed on highly heterogeneous and dynamic environment • Traditional ways to qualify test processes are based on code coverage metrics

  4. ISSTA 2006 Speeding up Test Execution Distribute Prioritize Select

  5. ISSTA 2006 Dealing with Configuration Mistakes • Build several different test environments • Expensive • Time consuming • Does not cover different user and administrative policies

  6. ISSTA 2006 Agenda • Motivation • To present a solution to test grid applications • How to describe a test of a grid application • Conclusions and Future Work

  7. ISSTA 2006 Environmental Coverage • Development environments are controlled • Test applications designed to run on heterogeneous environments in a set of different production environments

  8. ISSTA 2006 GridUnit Speeds up test execution by exploring the high levels of parallelism provided by the grid Provides a way to detect configuration mistakes by exploring the heterogeneous nature of the grid: Shared by multiple users Without a centralized control unit Composed by multiple administrative domains (virtual organizations)

  9. ISSTA 2006 GridUnit Architecture

  10. ISSTA 2006 InGriD • Builds environments in grid machines • Manages all environments deployed in the grid • It is an extension of Smart Framework for Work Group (SmartFrog), developed by HP Labs • Deal with grid machines

  11. ISSTA 2006 InGriD Architecture

  12. InGriD and a Grid: How it works Job Description File ... Requirements: environment = seghidro ... Broker Peer Site 1 Site 2 Site N Machines with seghidro environment ISSTA 2006

  13. ISSTA 2006 Testing a Real Application • The application creates a web album from a set of digital images • Time consuming • Photo editing is independent from each other • Grid nodes have: • Sun JVM 5.0 and JRockit 5.0 • Intel Pentium 4 and Intel Itanium 2 • 4 environments

  14. ISSTA 2006 Running the Tests Environment Description Grid InGriD GridUnit JUnit Automated Tests + Test Session Spec.

  15. ISSTA 2006 1. Environment Specifications

  16. ISSTA 2006 2. Test Session Specification

  17. ISSTA 2006 OurGrid • Largest computation grid in production in Brazil today • About 30 organizations (UFCG, USP, PUC-RS, UFPE, PUC-Minas, UFF, UFPB, UFBA, UCB, LNCC, UNISANTOS, ...) •  300 machines

  18. GridUnit + OurGrid • Does not require any source code modification • Open Source • Free to use and free to join ISSTA 2006

  19. ISSTA 2006 Screenshot – Green Bar

  20. ISSTA 2006 Screenshot – Red Bar

  21. ISSTA 2006 Screenshot – Gray Bar

  22. ISSTA 2006 Conclusions and Future Work • We presented a proposal of a solution to improve the confidence of heterogeneous environment applications • InGriD: to describe and deploy test environments • GridUnit: to coordinate and monitor execution of test sets • Environmental coverage metric is complementary and orthogonal to test coverage metrics • Formalization of the environmental coverage metric for software testing

  23. Additional Information: Alexandre Duarte – alex@dsc.ufcg.edu.br Gustavo Wagner – gugawag@gmail.com Francisco Brasileiro – fubica@dsc.ufcg.edu.br Walfredo Cirne – walfredo@dsc.ufcg.edu.br http://gridunit.sourceforge.net http://sourceforge.net/projects/ingrid-project http://www.ourgrid.org 谢谢 - Thank you – Obrigado Merci – Danke – Arigato - Gracias

More Related