1 / 36

A Embedded software component quality framework

This framework aims to improve the quality of embedded software components through certification, ensuring reliability and efficiency in the development process. It includes a set of activities, metrics, and guidelines based on established standards.

hughesj
Download Presentation

A Embedded software component quality framework

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Embedded software component quality framework Fernando Ferreira de Carvalho Advisor: Silvio Romero de Lemos Meira Informatics Center - Federal University of Pernambuco C.E.S.A.R. - Recife Center for Advanced Studies and Systems ffc@cin.ufpe.br 12-Junho-2008

  2. A Embedded software component quality framework Introduction / Motivation Embedded system is at the heart of many systems So, embedded system industry needs, Low production cost Short time to market High Quality to be more efficient and competitive (Brown, 2000) The CBD with reuse technique had been a nice direction to reach this objectives… But, Component reuse withoutquality assurance give catastrophic results [ariane]. http://www.rise.com.br Fernando Carvalho, PhD Candidate

  3. A Embedded software component quality framework Introduction / Motivation The CBD technologies do not take into account the specifics needs of embedded-systems development: Timing, Memory, power, hardware constraints and others. SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  4. A Embedded software component quality framework Introduction / Solution Certification is the future of software components[Wallnau, Heineman, Councill, Shaw] According to Weber et al. (Weber et al., 2002), the need for quality assurance in software development has exponentially increased in the past few years SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  5. A Embedded software component quality framework Introduction / Motivation Benefits More reliability Short time-to-market; More product quality; higher quality levels, reduced maintenance time, investment return, reduced time-to-market, among others Wide used, where certification is mandatory (aircraft) SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  6. A Embedded software component quality framework Rise Framework SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  7. A Embedded software component quality framework Component Certification Process SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  8. A Embedded software component quality framework Component Certification Processfocused in embedded systems An Embedded Computer System: A computer system that is part of a larger system and performs some of the requirements of that system; for example, a computer system used in an aircraft or rapid transit system. (IEEE,1992). SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  9. A Embedded software component quality framework Component Certification Processfocused in embedded systems • Embedded systems : • Used for specifics propose • Used to control systems (ex: mechanical machines) • Ultra small devices with simple specific functionality • Small systems with sophisticated functions • Produced in large scale SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  10. A Embedded software component quality framework Component Certification Processfocused in embedded systems Embedded systems has a specific requirements: - real-time - hi reliability - low power consumption - low data and code memory - low resources - low CPU capabilities - others SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  11. A Embedded software component quality framework Problem Formulation The CBD is an efficient and effective way for design of simple and complex embedded systems. However, quality assurance of components is must be done to take advantage of CBD. The Software industrystill far to reach the maturity level the hardware industry which it have catalogues and datasheets available for its components. For this reason, a well-defined and consistent embedded software component quality assurance is essential for CBD and reuse adoption. SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  12. A Embedded software component quality framework Proposed solution An Embedded Software Component Quality Verification Framework It is composed of four inter-relation module:, based on a set of activities, metrics and guidelines. • Embedded software component Quality Model (EQM) • Maturity Level evaluation Techniques • Metrics Approach • Component Certification based on a set of activities, metrics and guidelines. SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  13. A Embedded software component quality framework Proposed solution This Framework is based in the standards • ISO/IEC 9126, 2001 - Quality Model for Software Product • ISO/IEC 14598, 1998 - Software Product Evaluation Process This two standards converged to: • ISO/IEC 25010, 2005 - Software product quality - requirements and evaluation • theFramework adapted thequality modelandevaluationto component context and embedded domain. SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  14. A Embedded software component quality framework Out of scope This Framework is part of broad context, some aspects were expectedsince initial definition. Nevertheless, other process can be added in the future. • Cost Model • Formal Proof • Prediction of the component assembly SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  15. A Embedded software component quality framework 2 – Embedded System Design Embedded system design comprise: • Ultra-small device x simple functionality • Small system x sophisticated functions • Large systems and distributed systems • Systems produced in large quantities x low production cost • Systems produced in low volume x important features SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  16. A Embedded software component quality framework Component Certification Processfocused in embedded systems But the specifics requirements depends on the application (domain) - Industrial Automation - Automotive - Medical - Consumer electronics - Aircrafts - others … SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  17. A Embedded software component quality framework Component Certification Processfocused in embedded systems • So, embedded component certification process must be different that general propose component, because the component evaluation is realized focused in other requirements • We divided in two groups: • General propose sw component certification process • desktops, servers, x86 architecture • Specific propose sw component certification process(embedded systems, others architectures) SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  18. A Embedded software component quality framework Component Certification Processfocused in embedded systems (requiriments) • Industrial Automation (Crnkovic et al., 2005) • In the lowest levels: • availability, • timeliness, and • reliability • At higher levels: • performance, • usability, and • integrability SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  19. A Embedded software component quality framework Component Certification Processfocused in embedded systems (requirements) • Automotive (Åkerholm e.t. al, 2004) • Extendibility • Maintainability • Usability • Predictability • Security • Safety • Reliability • Testability • Flexibility • Efficiency SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  20. A Embedded software component quality framework Component Certification Processfocused in embedded systems (requirements) • Medical (Wijnstra e.t. al,2001) • Reliability • Safety • Functionality • Portability • Modifiability • Configurability • Extensibility and Evolvability • Testability • Serviceability SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  21. A Embedded software component quality framework Embedded Software Component Quality Process • Certification is the future of software components[Wallnau, Heineman, Councill, Shaw] • RiSE Approach • Embedded Component Quality Model (ECQM) • Embedded Software Component Maturity Model (ESCMM) • Certification Techniques Framework • Defining techniques for evaluate quality attributes of ECQM • Metrics Framework • Track the properties of the ECQM, certification techniques and process. • Embedded Software Component Certification Process • Defining the steps for certify a component SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  22. A Embedded software component quality framework Embedded Component Certification Process Changes in the Proposed Component Quality Model, in relation to ISO/IEC 25010 • Embedded Component Quality Model (ECQM) • Embedded Software Component Maturity Model (ESCMM) • Based ISO/IEC 25010 (*) standard, with some news and extended characteristics. Characteristics Sub-Characteristics Functionality Suitability Accuracy Interoperability Security Compliance Self-contained Reliability Maturity Recoverability Fault Tolerance Usability Understandability Configurability Learnability Operability Efficiency Time Behavior Resource behavior Scalability Maintainability Analyzability Stability Changeability Testability Portability Deployability Replaceability Adaptability Reusability *ISO/IEC 9126 - Software Products Quality ISO/IEC 14598 - Evaluation software product Marketability Development time Cost Time to market Targeted market Affordability Licensing SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  23. A Embedded software component quality framework Embedded Component Certification Process Characteristics Sub-Characteristics • Embedded Component Quality Model (ECQM) Functionality Suitability Accuracy Interoperability Security Compliance Self-contained Changes in the Proposed Component Qualit Model, in relation to ISO/IEC 25010 Reliability Maturity Recoverability Fault Tolerance Usability Understandability Configurability Learnability Operability Efficiency Time Behavior Resource behavior Scalability Maintainability Analyzability Stability Changeability Testability Portability Deployability Replaceability Adaptability Reusability Marketability Development time Cost Time to market Targeted market Affordability Licensing SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  24. A Embedded software component quality framework • 2. Certification Techniques Framework • Defining techniques for evaluate quality attributes of ECQM Guidelines for selecting evaluation level. Level Environment Safety/Security Economic ESCMM I No damage Few material damage; No specific risk Negligible economic loss ESCMM II Small/Medium damage properly Few people disabled Few economic loss ESCMM III Damage properly Large number of people disabled Significant economic loss ESCMM IV Recoverable environment damage Threat to human lives Large economic gross ESCMM V Unrecoverable environmental damage Many people killed Financial disaster SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  25. A Embedded software component quality framework • 2. Certification Techniques Framework • Defining techniques for evaluate quality attributes of ECQM Guidelines for selecting evaluation level. Level ESCMM I ESCMM II ESCMM III ESCMM IV ESCMM V Reliability Suitability analysis • Programming Language Facilities (Best Practices) • Maturity analysis • Fault tolerance analysis • Error Manipulation analysis Reliability growth model Formal Proof SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  26. A Embedded software component quality framework • 3. Metrics Framework • Track the properties of the ECQM, certification techniques and process. Functionality Sub-Characteristic Accuracy Quality Attribute Correctness Goal Evaluates the percentage of the results that were obtained with precision Question Based on the amount of tests executed, how much test results return with precision? Metric Precision on results / Amount of tests Interpretation 0 <= x <= 1; which closer to 1 is better SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  27. A Embedded software component quality framework • 4. Embedded Software Component Certification Process • Defining the steps for certify a component • 4.1 Establish Evaluation Requirements activity • 4.2 Specify the Evaluation activity • 4.3 Design the Evaluation activity • 4.4 Execute the Evaluation activity SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  28. A Embedded software component quality framework 4. Embedded Software Component Certification Process SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  29. A Embedded software component quality framework 4.1 Establish Evaluation Requirements activity SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  30. A Embedded software component quality framework • 4.2 Specify the Evaluation activity SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  31. A Embedded software component quality framework • 4.3 Design the Evaluation activity SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  32. A Embedded software component quality framework • 4.4 Execute the Evaluation activity SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  33. A Embedded software component quality framework Submissão de artigo dia 05/06/2008 - SBCARS SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  34. A Embedded software component quality framework SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  35. A Embedded software component quality framework Thank you ! Questions ? Fernando F. de Carvalho ffc@cin.ufpe.br SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

  36. A Embedded software component quality framework Embedded Component Certification Timeline SAAP 2008.1 http://www.rise.com.br Fernando Carvalho, PhD Candidate

More Related