370 likes | 386 Views
Part V: Working with Test Documentation. Outline. 17 Planning Your Test Effort 18 Writing and Tracking Test Cases 19 Reporting What You Find 20 Measuring Your Success. Planning Your Test Effort. The purpose of test planning
E N D
Outline • 17 Planning Your Test Effort • 18 Writing and Tracking Test Cases • 19 Reporting What You Find • 20 Measuring Your Success
Planning Your Test Effort • The purpose of test planning • is a by-product of the detailed planning process that's undertaken to create it. • The ultimate goal of the test planning process is communicating (not recording) the software test team's intent, its expectations, and its understanding of the testing that's to be performed
Test Planning Topics • High-Level Expectations • What's the purpose of the test planning process and the software test plan? Who know that? • What product is being tested? • What are the quality and reliability goals of the product? • People, Places, and Things • Files ,Sotware,hardware
Test Planning Topics • Definitions • concepts that need to be defined for a software project • terms • Build • Test release document (TRD). • Alpha release • Beta release • Feature complete • Bug committee
Test Planning Topics • Inter-Group Responsibilities
Test Planning Topics • What Will and Won't Be Tested • Test Phases • unique phases, or stages, of testing should be performed over the course of the project • Test Strategy • manually and other code with tools and automation? • Resource Requirements • People, Equipment, Office and lab space, Software, Outsource companies, Miscellaneous supplies
Test Planning Topics • Tester Assignments
Test Planning Topics • Test Schedule
Test Planning Topics • Test Cases • write,maintains • Bug Reporting and trace • Bugzilla • Metrics and Statistics • Risks and Issues • identifying risks during the planning process and communicating your concerns to your manager and the project manager.
Writing and Tracking Test Cases • writing and tracking test cases • test design specification • test case specification • How test procedures should be written? • How test cases should be organized?
Writing and Tracking Test Cases • Carefully and methodically planning test cases • Organization & manage test case • Repeatability • Tracking result • Proof of testing (or not testing).
Writing and Tracking Test Cases • different levels of test documents • IEEE 829 • Word template
Writing and Tracking Test Cases • Test Design • Identifiers • Features to be tested. • Approach • Test case identification. • ID#15326 • Pass/fail criteria.
Writing and Tracking Test Cases • Test Cases • Identifiers • Test item • Input specification. • Output specification. • Environmental needs • Special procedural requirements. • Intercase dependencies
Writing and Tracking Test Cases • Test Procedures • Identifier • Purpose • Special requirements • Procedure steps • Log Setup Start Procedure Measure. Shut down. Restart. Stop. Wrap up Contingencies.
Writing and Tracking Test Cases • Test Case Organization and Tracking • In your head • Paper/documents • Spreadsheet • Custom database.
Reporting What You Find • why not fixing all the bugs • There's not enough time • It's really not a bug • It's too risky to fix • It's just not worth it. • Ineffective bug reporting
Reporting What You Find • fundamental principles reporting a bug • Report bugs as soon as possible • Effectively describe the bugs • Minimal, Singular, Obvious and general, Reproducible • Be nonjudgmental in reporting bugs • Follow up on your bug reports.
Reporting What You Find • Isolating and Reproducing Bugs • Don't take anything for granted • Look for time-dependent and race condition problems • boundary condition bugs, memory leaks, and data overflows • State bugs show up only in certain states • resource dependencies and interactions with memory,network… • Don't ignore the hardware
Reporting What You Find • Not All Bugs Are Created Equal • Severity indicates how bad the bug is; the likelihood and the degree of impact when the user encounters the bug. • System crash, data loss, data corruption, security breach • Operational error, wrong result, loss of functionality • Minor problem, misspelling, UI layout, rare occurrence • Suggestion
Reporting What You Find • Priority indicates how much emphasis should be placed on fixing the bug and the urgency of making the fix. • Immediate fix, blocks further testing, very visible • Must fix before the product is released • Should fix when time permits • Would like to fix but the product can be released as is
Bug-Tracking Systems • The Test Incident Report • Identifier • Summary • Incident Description. • Impact • Manual Bug Reporting and Tracking • Automated Bug Reporting and Tracking
Measuring Your Success • What areas of the software you're testing have the most bugs? The fewest bugs? • How many resolved bugs are currently assigned to Martha? • Bob is leaving for vacation soon. Will he likely have all his bugs fixed by then? • Which software tester has entered the most bugs? • Does the software look like it's on track to meet the scheduled release date?
Measuring Your Success • databases have a means to build queries that return the specific information you're looking
质量保证 • Software Testing • The goal of a software tester is to find bugs, find them as early as possible, and make sure they get fixed. • can't make an inherently poor-quality product better. Quality can't be tested in. Period. • Quality Assurance • Software Quality Assurance person's main responsibility is to examine and measure the current software development process and find ways to improve it with a goal of preventing bugs from ever occurring.
Software Quality Assurance • Capability Maturity Model (CMM) • 1-5 • ISO 9000 • ISO 9001 is for businesses that design, develop, produce, install, and service products. • ISO 9000-3 is for businesses that develop, supply, install, and maintain computer software.
Career as a Software Tester • Job as a Software Tester • Software Test Technician. • Software Tester or Software Test Engineer • Software Test Toolsmith or Software Development Engineer in Test • Software Test Lead • Software Test Manager
Formal Training Opportunities • Conferences • International Software Testing Conference (ISTC) • Software Testing Analysis & Review (STAR), • International Conference on Software Quality (ICSQ) • International Conference on Software Testing (ICSTEST), • The World Conference for Software Quality (WCSQ)
实习四 • 运用测试技巧 • 执行《运用测试技巧》各项测试 • 可以交换测试
完成课程报告 • 测试用例的设计、实现 • 静态白盒测试 • 问题 • 解决方法 • 单元测试 • 用例 • Bug和解决方案 • 运用测试技术 • Bug • 解决方案