1 / 45

Improving Test System Development

Improving Test System Development. Wyatt Meek –VISTA Product Manager & ES Sales Support. Agenda. Introduction to V I Engineering Past Projects Common Development Issues Benefits of VISTA. History of V I Engineering. Founded in 1992 Select NI Alliance Member

emery
Download Presentation

Improving Test System Development

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Improving Test System Development Wyatt Meek –VISTA Product Manager & ES Sales Support National Instruments Confidential

  2. Agenda • Introduction to V I Engineering • Past Projects • Common Development Issues • Benefits of VISTA

  3. History of V I Engineering • Founded in 1992 • Select NI Alliance Member • Four Locations (60+ employees) • Farmington Hills, MI (HQ) • St. Paul, MN • Indianapolis, IN • Los Angeles, CA • Business Units • Engineering Services • Engineering Information Management Systems (EIM) • VISTA

  4. Engineering Services Overview • Services Expertise • Project Management • Systems Engineering • Software Engineering • Partners • COTS Instrumentation\HW Suppliers (NI, Agilent, Virginia Panel, Pickering, QuadTech, Tektronix, others) • Custom PCB, Cable, Fixture Manufacturers • Avg Breakdown by Cost for $100k+ Systems • 50% Services (all VIE), 30% COTS HW, 20% Custom HW (partners)

  5. Leadership Position • NI Alliance “Integrator of the year” 2003 • Authored Advanced Application Development Course • Developed Software Engineering Tools for LabVIEW • Most Certified LabVIEW and TestStand Developers and Architects Worldwide (Jan 2005) • CSIA (www.controlsys.org) Member and Board Position • Standardized on SysML and UML • PMI (www.pmi.org) Certified Managers • Partnered with SCAMPI (www.sei.cmu.edu) Certified Appraisers

  6. Multi-Industry Experience

  7. Customer Examples • DoD Contractor • Microsoft • Honeywell • Trane • Rolls Royce • Cummins

  8. DoD Contractor • 500 Channels of Real Time Control (1 KHz) and DAQ (up to 32 KHz/Ch) • Multiple NI PXI/SCXI chassis, with PLC manual/back-up system • LabVIEW RT with GOOP architecture • Database Driven Test Setup • DIAdem Reports for Post Test Analysis • Remote Display of Active Test Information • Complete Black-box as well as Partial White-box SW Testing • VISTA Tools Used • CM, PM, GOOP, QA 

  9. Microsoft - EOL XBOX Controller Test Systems • $20k Savings with PXI and 5112 Scope • 20 Fold Reduction in Test Time • Compact and Rugged Chassis Ideal for Far East Production • User interface • Engineering • Production “I am extremely impressed with VIE’s problem solving abilities, their understanding of our needs and their dedication to a quality solution. This has made them partners I will continue to work with well into the future. V I Engineering is a world class system integrator.” - Jeff Alexander Lead Hardware Test Engineer Microsoft Corporation

  10. Honeywell – RF Valve and Remote Tester • Parallel Product and Test System Development • Software – LabVIEW, IMAQ, SQL Toolkit • Hardware • NI (PCI-6023E, PCI-1408, SCC-2345, PCI-DIO-32HS, PCI-GPIB) • Agilent (DMM, power supply, spectrum analyzer, signal generator) • Custom (Anechoic chamber, patch antenna, bed of nails, clamping fixture) • RF Test, RF Receive, Vision, Field Strength, Integration • Yields Monitored in MN in Real Time

  11. Trane – HVAC Production & R&D System • $25k Savings Per Duplicate System w/ PXI (8 total systems delivered) • Replacement of Multiple Antiquated Instruments • Scientific Atlanta 2521 for vibration measurements • Bentley Nevada/DVF2 for balancing • Improved Detection and Measurement of Baseline Vibration Characteristics • Improved reliability of test system • Increased efficiency in diagnosing a solution to a problem (error database) • Developed deeper analysis for product improvements • Type of Tests: • Balancing test/steady state vibration test • Sound test • Hit test

  12. Rolls Royce Engines – On Wing Diagnostics • NI Compact RIO System • Portable • Rugged • Analog & Digital I/O • LabVIEW RT • Mounts within Engine Shroud • Testing capable during full power up • Flash Memory Integration

  13. Cummins – Data Management System • DIAdem Standard for Analysis Tool • Designed and Developed Custom Toolbox • Leverages Best Practices • 90% Productivity Gain through Automation • Corporate Taxonomy • Universal naming conventions • Standard engineering units • Standard file types

  14. What Our Customers Say • “VI’s staff is unbelievable. You guys are just great. I mean you know hardware, software…and you know how to help us on the floor. Your people are really professionals.” - Honeywell • “Everyone here loves you guys, I’ve been in this business for a long time and I’ve never seen a group as professional as you guys…” - Bosch

  15. What Our Customers Say • Would it be OK if I hugged you?” – Intel • Ya know…you guys could teach us..” and “You guys need to slow down, we can’t keep up…” - Microsoft

  16. Example Production System

  17. Examples of Rack Systems

  18. Examples of Rack Systems

  19. Examples of Rack Systems

  20. Common Development Issues • Lack of Development Process • Configuration Management • Project Management • Traceability • Quantifying Test Coverage • Tailoring Traditional Software Processes to LabVIEW

  21. research/definition Simplified Waterfall Model for Software Development requirements specification ship/maintain design coding testing

  22. All Too Often… LabVIEW makes it very easy to quickly put something together research/definition requirements specification ship/maintain design coding testing Developers do not follow a process

  23. Case Study Source: CMU/SEI-94-TR-013

  24. Case Study Source: CMU/SEI-94-TR-013

  25. Challenges with Process Implementation for LabVIEW and TestStand • LabVIEW and TS File Handling • Embedded Source and Object • Static Linkage • Metrics • Complexity • Size • Design Methodology • Style • Patterns

  26. VISTA by V I Engineering Software engineering approach to the management, development and release of LabVIEW and TestStand software. • Process Consulting • Training • Development and Process Tools

  27. VISTA Configuration Management Tools • Menu Functions • LV and TS integration with VSS or ClearCase (others in development) • Add, Check In/Out, Get Version, Undo Check Out, Label • Project Management Tool Functions • Basic CM functions • File comparison • File load check • Project baselines (lock, unlock, save, load) • Build with integrity (exe or native)

  28. VISTA Configuration Management Tools • Menu Functions • LV and TS integration with VSS or ClearCase (others in development) • Add, Check In/Out, Get Version, Undo Check Out, Label • Project Management Tool Functions • Basic CM functions • File comparison • File load check • Project baselines (lock, unlock, save, load) • Build with integrity (exe or native) • Up to 20% time savings through automation • of basic and advanced CM Functions • Peace of mind from system integrity

  29. Importance of Metrics • Confirm Estimates • Project Monitoring • Cost Justification • Risk Analysis • Impact of Change • Track Improvement Initiatives • Reuse • Productivity • Diagnose root cause of project failure “You can’t manage what you can’t measure”

  30. LabVIEW Metrics • Hours • SLOC Equivalent Metric • Nodes (VI Metrics) • GOBs (Graphical OBjects calculator) • Cyclomatic Complexity (possible, but not yet available) • EVA

  31. Metrics Trials • LabVIEW Developer Exams • GOBs more reliable than nodes • V I Engineering • ~10 GOBs/hr for product development and regulated industries • Ball Aerospace • 8-10 GOBs/hr for 2 week to 2 man year projects • General Dynamics (CMMI Level 3) • 8.7 GOBs/hr avg for 8000 man hours of work

  32. VISTA Project Management Tools • Metrics Calculator • GOBs, nodes • Project Management Tool • Status accounting with labels • PM Tool Database • Time tracking • Metrics tracking • Estimation wizard • MS Project integration

  33. VISTA Project Management Tools • Metrics Calculator • GOBs, nodes • Project Management Tool • Status accounting with labels • PM Tool w/ Integrated Database (alpha rel) • Time tracking • Metrics tracking • Estimation wizard • MS Project integration • More accurate estimates based on historical metrics • Quantitative project monitoring • Understanding root cause of failure/success

  34. VISTA Quality Assurance • Node/Path Tracker (alpha rel) • Traceability Tool (internal use only)

  35. VISTA Quality Assurance • Node/Path Tracker (alpha rel) • Traceability Tool (internal use only) • Calculate percentage of the application tested • Documentation of functions tested/not tested • Add test cases for greater coverage • Complete Traceability

  36. VISTA Productivity and Documentation Tools • Help Generator • Renaming and Relocation Tool • Documentation Tool • Reuse Library • Style Guide

  37. VISTA Productivity and Documentation Tools • Help Generator • Renaming and Relocation Tool • Documentation Tool • Reuse Library • Style Guide • Up to 50% cost savings associated with task of • documenting VI’s • Time savings associated with maintenance and • peer reviews due to common style • Cost savings through greater reuse

  38. VISTA GOOP Tools • GOOP Inheritance Toolkit • GOOP Wizard 3 with inheritance • Icon editor • Development distribution tool • UML Editor • State, class, sequence diagrams • Auto class generation from UML • Auto UML generation from code

  39. VISTA GOOP Tools • GOOP Inheritance Toolkit • GOOP Wizard 3 with inheritance • Icon editor • Development distribution tool • UML Editor • State, class, sequence diagrams • Auto class generation from UML • Auto UML generation from code

  40. Advanced LabVIEW Training • Advanced Application Development • Define Design Templates and Style • Advanced Programming Techniques • System Design with GOOP • Object Oriented Analysis and Design • Iterative Development

  41. VISTA Success Stories “VISTA expanded my horizons; it promoted better programming practices and raised our quality.” - LLNL “Complete Reuse. In 14 years of automation engineering, this is the first time I have had 100% reusable code.” – WMS Gaming on their GOOP implementation “The AAD Course is the most useful training course I’ve ever taken” - Boeing • Medtronic • 60% reduction in development and maintenance costs for a group of 15 • Lawrence Livermore National Labs • ISO 9001 certification; 30% reduction in development costs for a group of 5 • Rockwell Collins • CMMI Level 5 • WMS Gaming • Lowered cost of upgrades and duplicated systems by 70% • V I Engineering

  42. Turn Key System Development Project Support Architecture Design Process Assessment Custom and Advanced Training Tools How Can V I Engineering Help You? Learn more at www.vista.viengineering.com www.viengineering.com

More Related