210 likes | 214 Views
Maintaining Program Integrity. The Role of Product Testing. Goal: Protect the integrity of the label Require the submission of appropriate test data on a product specific basis
E N D
The Role of Product Testing • Goal:Protect the integrity of the label • Require the submission of appropriate test data on a product specific basis • Enhancing ESTAR Test Methods by referencing industry test procedures, developing test facility manuals, and requiring third-party documentation, where necessary • Implementing Testing Initiative to identify potential compliance problems • Set in motion a review process to ensure manufacturers take corrective measures
Referencing Industry Test Procedures • Dehumidifiers:Test Criteria: Tests shall be conducted in accordance with Clauses 4, 5, and 7 of ANSI/AHAM Standard DH-1, except that a watt-hour meter shall be used to measure dehumidifier energy consumption during the capacity rating test. The watt-hour meter shall be accurate within 0.5 percent of the indicated value and have a scale with graduations of 1 watt-hour or less. Energy Factor is to be calculated according to Section 4.2 of CAN/CSA-C749-94.
Quality Assurance: Improved Test Methods • EX:ESTAR Ceiling Fan Test Facility Guidance Manual • Provides procedures and specifications for building and setting up an air delivery room, specifies equipment, test method reporting procedures • Requires laboratories to calibrate to ensure consistent, repeatable results • All laboratories are required to calibrate, using the same reference fan, once a year and produce results within +/-3% of each other.
Quality Assurance: Improved Test Methods (cont.) • EX:ESTAR Monitor Test Method Committee • More than 30 industry representatives collaborating with EPA on the draft monitor test method • References published specifications from VESA and IEC • supplement guidelines where necessary with methods developed in cooperation with industry • Process will ensure On Mode testing consistency among manufacturers
Compliance Testing Initiative • Selecting products with greatest market share • Using existing ESTAR testing guidelines • Independent testing lab • Stakeholder communication protocol with defined steps for non-compliance • Test results and recommendations • July/August -- Televisions • Nov. -- DVDs • Dec./Jan. -- Monitors • Future efforts under consideration: potential on-site test method evaluations
Manufacturer Model Number Energy Star Limit in Standby Mode (Watts) Standby Mode Power (Watts) Pass/Fail Unit #1 Unit #2 Unit #3 1 A 3.0 0.7 0.7 0.8 Pass 1 B 3.0 0.7 0.7 0.7 Pass 1 C 3.0 0.6 0.6 0.6 Pass 1 D 3.0 0.4 0.5 0.4 Pass 1 E 3.0 1.0 1.2 0.9 Pass 2 A 3.0 2.8 2.7 2.7 Pass 2 B 3.0 1.1 1.0 1.2 Pass 2 C 3.0 2.9 2.9 3.0 Pass 2 D 3.0 0.7 0.9 0.9 Pass 2 E 3.0 0.8 0.6 0.7 Pass 2 F 3.0 0.7 0.7 0.5 Pass 2 G 3.0 0.5 0.4 0.4 Pass 2 H 3.0 0.4 1.4 1.9 Pass 3 A 3.0 1.6 2.5 1.6 Pass 3 B 3.0 1.8 2.0 1.8 Pass TV Results
Manufacturer Model Number DVD Product Type Audio/DVD Partner Status Standby Mode Power (Watts) Pass/Fail Unit #1 Unit #2 Unit #3 1 A DVD No 0.0 0.0 0.0 N/A (Pass) 2 A DVD No 1.3 1.2 1.2 N/A (Pass) 3 A DVD Yes 2.0 1.9 1.7 Pass 3 B DVD Yes 2.4 2.4 2.4 Pass 3 C DVD Yes (model labeled, but not qualified) 1.4 1.4 1.5 Pass 3 D DVD/VCR Yes 3.2 3.5 3.1 Pass 4 A DVD No 2.9 1.8 1.8 N/A (Pass) 5 A DVD/VCR Yes (model isn’t labeled or qualified) 11.6 7.6 7.4 N/A (Fail) 6 A DVD Yes 1.7 2.0 2.0 Pass 7 A DVD Yes 0.3 0.4 0.3 Pass 7 B DVD Yes 0.4 0.6 0.4 Pass 7 C DVD Yes 0.5 0.8 0.3 Pass 7 D DVD Yes 0.6 0.6 0.4 Pass 7 E DVD Yes 0.3 0.3 0.3 Pass 8 A DVD Yes (model labeled, but not qualified) 0.9 0.9 0.9 Pass DVD Results
Lighting: Fixtures and Bulbs • Routine/ongoing testing initiative • PEARL -- creation and funding of certified lab to test product quality and performance • Two rounds of testing to date • Products failing are removed from ENERGY STAR
Retail PartnerStore Level Assessment Background and Summary Rounds 1 & 2
Retail Store Level Assessment • Designed to evaluate the consumer shopping experience with ENERGY STAR in retail channel • Programmatic changes to increase product purchases • Three part assessment: • Salesperson knowledge and extent ENERGY STAR messaging is used in sales process • Visibility/presence of ENERGY STAR in store displays by department • Availability/visibility of ENERGY STAR qualified and labeled products in stores
Basic Approach • Approx. 7 qualified product categories for each trial (e.g., DVDs, TVs); some variability • Approx. 5 national retailers including Best Buy, Home Depot, Lowe’s, Sears, Wal*Mart • Approx. 7 cities across the country from MA to CA
Atlanta, GA Baltimore, MD Boston, MA Dallas, TX Milwaukee, WI Portland, OR San Diego, CA TVs (fall 01) DVDs (summer 02) Cities/Products Fall & Summer
Evaluation Process • Sales Staff Evaluation • “Shoppers” Evaluate • 3 top considerations identified during sale • Mention of ENERGY STAR and understanding of program goals, elements, or features during the sales process • Combine to one score and scale to “100” • To reach “100” • Present ENERGY STAR, energy efficiency, and environment as top considerations • Demonstrate thorough knowledge of ENERGY STAR program during the sale
Evaluation Process • Display Check • Display material (POS/POP) present beyond labeled products • Who generates/applies and relative size • Product Shelf Inventory • Measure proportion ENERGY STAR-qualified products on shelves • Check visibility/presence of ENERGY STAR label on products and packaging
Summary Findings – 2 rounds • Salesperson knowledge • Scores by product 25-50 • Highest = CFLs, appliances • Lowest = electronics • Store display visibility • Little difference in presence of ENERGY STAR focused materials in the two rounds • High opportunity in lighting and CE departments to coordinate materials with ENERGY STAR product promotions
Summary Findings – 2 rounds • Product inventory • Shelf area devoted to qualified products consistent with market penetration data • Ideal = see increase, over time, in inventory of ENERGY STAR qualified products • Product labeling • 26% of qualified DVD models not labeled at all; 26% models “mixed” • Small number of products “mis-labeled”
Our Action Steps • Retail partner “strategies” • Best Buy, Costco, Nationwide, RadioShack, Sears, Wal*Mart • Training/Product stocking • Promotion “matchmaking” • Contact with retailers/vendors • Website re-engineering • Shopping tool more robust • Qualified Product lists more accurate, easier to use
Our Action Steps • Future RSL plans • 2 rounds/year • Some variation in products/retailers • Local appliance/electronics dealers included on a limited basis • Questions
Logo Monitoring • Newspaper/magazine clips • monthly • Websites • quarterly • Follow up • calls • letters • referral to DOJ
Discussion and Feedback • Are there additional measures we should consider taking to protect the integrity of the ENERGY STAR label?