1 / 20

September 2008

A Discerning Approach to 3 rd Party Testing Overview of 3 rd Party Testing, including latest Symantec Endpoint Protection Results from the Tolly Group. September 2008. Agenda. Demystifying 3 rd Party Testing. 1. The Tolly Group: Impact on Office Productivity. 2. Reviewing the Checklist.

zachary-mccoy
Download Presentation

September 2008

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Discerning Approach to 3rd Party TestingOverview of 3rd Party Testing, including latest Symantec Endpoint Protection Results from the Tolly Group September 2008

  2. Agenda Demystifying 3rd Party Testing 1 The Tolly Group: Impact on Office Productivity 2 Reviewing the Checklist 3 Q&A 4

  3. The Big Question:Who performed the test? • Do they have a testing Charta? • Who paid for the test? • Notify competitors about the test? • Detailed test methodology description? Example: Network Testing Labs • No website • Don’t mention who paid for the test • Misleading “World Class Award”

  4. Is the setup fair? Example: McAfee commissioned Tolly report in June 2008

  5. Pay Attention to the details: McAfee confirmed that the malware samples used in this test were actual samples submitted to McAfee researchers. Shouldn’t they detect 100% of their own samples?

  6. Is the test relevant? • Example: McAfee commissioned Tolly report, June 2008

  7. Relevant details: McAfee’s Total Protection for Endpoint anti-malware solution processed 86 malware files per minute under extreme conditions where malware files were constantly copied onto the system. Who cares about the speed of scanning malware?

  8. Consider what they don’t say Example: Sophos commissioned Cascadia Labs Report, 2007

  9. AV-Comparatives: False Positives ~400 5 2 2 Source: AV-Comparatives – Anti-Virus Comparative No. 18, Page 7 (05/2008)

  10. Other favorite tactics • Didn’t get any positive reviews lately? • Use old data! • Nobody will read the footnote stating that it is from 2005 • Don’t have money for a third party review? • Create some charts from AV-Comparatives, VB100 and AV-Test! • They perform tons of tests and everybody is good at something • Nobody will read the full 20 page report and find all the negative things • Failed a test like Virus Bulletin? • Say it is irrelevant! • No test is perfect so we will always find something negative to say

  11. Latest Symantec Endpoint Protection 3rd Party Test • Highlight Symantec’s strengths vs. McAfee • Less impact on typical office usage • Faster open and save time for Word and PowerPoint • The Test • Symantec Endpoint Protection11.0 vs. McAfee Total Protection for Endpoint bundle • Measure time to open and save 5MB Microsoft Word file • Measure time to open and save 20MB Microsoft PowerPoint file • The Result • Symantec wins the test • Results are interesting!

  12. Productivity Impact Microsoft Office 2007/Vista File “Open” Times (Increase Over Unprotected System) Time (seconds) Source: The Tolly Group – Symantec Endpoint Protection vs. McAfee Total Protection for Endpoint Page 1 (08/2008)

  13. Productivity Impact Microsoft Office 2007/Vista File “Save/Close” Times (Increase Over Unprotected System) Time (seconds) Source: The Tolly Group – Symantec Endpoint Protection vs. McAfee Total Protection for Endpoint Page 1 (08/2008)

  14. Remember:The Checklist • Who performed the test? • The Tolly Group • Is the test fair? • Yes!! We used default settings, identical hardware and did not provide the test data. • Is the test relevant? • Yes – Everyone works with Microsoft Office • Is there something that you don’t say? • The charts show the impact not the actual time • Opening word files is relevant: 2.7 seconds vs. 4.2 seconds • Saving PowerPoint files less: 10.7 vs. 11.3

  15. SEP 11.0 Maintenance Release 3 (MR3) enhancements 15

  16. Symantec Endpoint Protection MR3 Improved Client Performance Significant Boot Time improvement Reduced Virtual Memory Reduced Application Load time Improved Management Server Performance Reduction in resources with new delta creation process Smaller incremental virus definitions Improved Reporting Management Additional information added and easier to read 16

  17. Symantec Endpoint Protection MR3 IIS Custom website now utilized More secure Avoid Conflicts Virtualization Support Randomize Client connections to SEPM for obtaining Content Updates Scalability Controls Group Update Provide modifications Other SNAC trialware now included! Available on FileConnect today: https://fileconnect.symantec.com/LangSelection.jsp 17

  18. Resources 18 • For more information on Symantec Endpoint Protection and the Tolly Report, please visit the Symantec Endpoint Security Website: http://www.symantec.com/business/products/family.jsp?familyid=endpointsecurity

  19. & QUESTIONS ANSWERS 20

More Related