PRT375: SharePoint Products Technologies: Performance and Capacity Planning, Best Practices and Lessons Learned

2. PRT375: SharePoint Products & Technologies: Performance and Capacity Planning, Best Practices and Lessons Learned Joel Oleson Technologist joelo@microsoft.com

3. IIS 6 Administration SharePoint Portal Server Windows SharePoint Services Prerequisite Knowledge

4. Agenda Microsoft IT Best Practices & Lessons Learned Microsoft IT�s Solution Capacity Planning Scalability & Manageability Performance Tuning FY06 References Q&A

5. Agenda Microsoft IT Best Practices & Lessons Learned Microsoft IT�s Solution Capacity Planning Scalability & Manageability Performance Tuning FY06 References Q&A

6. The Function of ITG The IT organization at Microsoft is unique in terms of the broad variety of responsibilities. The first role, like any other large organization, is to run the IT service. This is developing and maintaining information technology systems and solutions that help Microsoft employees do their jobs efficiently and effectively. Another aspect is providing a robust application and infrastructure architecture as the foundation for building line of business applications. We provide services ranging from end user support and telecommunications management to server and network operations. This includes managing the connectivity for over 150,000 PCs worldwide. We ensure that the nearly 50,000 employees and 5,000 contractors and 17,000 vendors in over 400* MS locations around the world are able to access the corporate network 24 hours a day, 7 days a week. Operating Environment The environment is: Dynamic. The rate of change is very high. Microsoft continues to grow, and within the past year Microsoft has also seen an increase in mergers and acquisitions activity. Large. It includes three enterprise data centers, but 450 locations worldwide. IT-managed infrastructure exists at over 200 of those sites. A real world environment. Users expect production quality services, even when deploying beta software. Corporate infrastructure on Windows (.NET) Server 2003 1,400 servers deployed including 220 domain Controllers and 13 key LOB applications The Function of ITG The IT organization at Microsoft is unique in terms of the broad variety of responsibilities. The first role, like any other large organization, is to run the IT service. This is developing and maintaining information technology systems and solutions that help Microsoft employees do their jobs efficiently and effectively. Another aspect is providing a robust application and infrastructure architecture as the foundation for building line of business applications. We provide services ranging from end user support and telecommunications management to server and network operations. This includes managing the connectivity for over 150,000 PCs worldwide. We ensure that the nearly 50,000 employees and 5,000 contractors and 17,000 vendors in over 400* MS locations around the world are able to access the corporate network 24 hours a day, 7 days a week. Operating Environment The environment is: Dynamic. The rate of change is very high. Microsoft continues to grow, and within the past year Microsoft has also seen an increase in mergers and acquisitions activity. Large. It includes three enterprise data centers, but 450 locations worldwide. IT-managed infrastructure exists at over 200 of those sites. A real world environment. Users expect production quality services, even when deploying beta software. Corporate infrastructure on Windows (.NET) Server 2003 1,400 servers deployed including 220 domain Controllers and 13 key LOB applications

7. IT SharePoint StrategyUser to Enterprise Consistency

8. The Microsoft Site Hierarchy

9. Global SharePoint Deployment

10. Agenda Microsoft IT Best Practices & Lessons Learned Microsoft IT�s Solution Capacity Planning Scalability & Manageability Performance Tuning FY06 References Q&A

11. Capacity Planning Plan for 25-50GB Databases Limit Number & Size of Sites per Database Use 250 sites per database = 25GB @ 100MB Microsoft Profile: Personal Site = 20MB Team Site = 60MB Data LUNS/Drives vs. Backup Drive

12. System Sizing Small Farm Scenario Availability not a concern Cost restrictive 1-3,000 Users Medium Farm Benefits * High Availability 99.9% Offloaded Indexing 1000-30,000 Users Large Farm Benefits Search Offloaded Indexing Offloaded Millions of documents 1000-30,000 Users Adding Front Ends 1 per additional 25,000 users

13. Hardware Decisions Web � Memory, NIC Search � NIC Index � CPU, NIC SQL � Memory, CPU, NIC, Backup Strategy

14. Americas Intranet Hardware

15. Agenda Microsoft IT Best Practices & Lessons Learned Microsoft IT�s Solution Capacity Planning Scalability & Manageability Performance Tuning FY06 References Q&A

16. SharePoint Growth and Scale

17. Usage Statistics on �Team�

18. Web CPU vs. Connections

19. MSWeb Quick Stats - 6 Million Files Indexed - 37GB Indexes - Largest 15GB 2.2M files Time to prop: 3 hr Time to crawl: 12 days - Content Sources 195

20. Manageability with MOM 2005 MOM Packs Windows SharePoint Services SharePoint Portal Server 2003 SQL 2000 IIS 6 Microsoft Cluster Service Windows 2003 Server Web Site Monitoring Web Sites and Services MP

21. Agenda Microsoft IT Best Practices & Lessons Learned Capacity Planning Scalability & Manageability Performance Tuning FY06 References Q&A

22. Key Perf Counters

23. Performance Tuning IIS Use few virtual servers Consolidate app pools, divide for poor performing Use web garden for max performance 3 W3WP work great one high usage virtual server on 4 GB box Limit WP Memory consumed to 500 - max 800MB Disable auto-rapid failure

24. App Pool Worker Processes Properties

25. Performance Tuning SQL Maintenance Plan Regular Defrag Dbs/Disks (Monthly/Quarterly) Regular DBCCs Cleanup/Offline Resource Planning FTS vs. SPS Search (MSSearch.exe) Instances? � 1 max for perf /server Disk Optimization (RAID Config)

26. Performance Tuning Memory Web Front End Server Memory Use 4 GB RAM Add /3GB to boot.ini SQL Use 4 GB RAM Add /3GB to boot.ini Add �g512 to SQL Startup Parameters Use AWE and /PAE for 8GB Machines (High End) Limit databases < 300

27. Performance Tuning Backups OM Site Backups don�t scale and cause SQL blocking SharePoint Database Explorer for file restore (Reskit) Third party compressed database backup Use Private Network or Fiber attached tape Disk Pivoting -Utilize Passive Node SPSBackup for Index only

28. Performance Tuning Network Private network or Fiber attached tape to offload network Configure Front End & Backend NIC w/ separate routes Use Crossover or hub/switch for NLB & MSCS Clusters GigE gave us 3X performance

29. Performance Tuning Index Planning Use Site Directory as Content Source Scope w/ Source Groups Use fewer Indexes Ad hoc content in larger index Important Content in smaller index Maintenance Avoid/Remove Single Threaded I-filters Avoid Indexing content twice Remove - default index every 10 min Limit # of indexing threads 3 million documents indexed, 3 key indexes 12 total indexes3 million documents indexed, 3 key indexes 12 total indexes

30. Performance Tuning Misc. Kerberos vs. NTLM vs. Basic IIS Compression - level 9 Third Party � Offline, Replication, Acceleration WSS & SPS SP1 Fixes SPS Search vs. FTS WSS Hot fix (Post SP1) KB: 889385 (SharePoint Usage & Site Backup)

31. Agenda Microsoft IT Best Practices & Lessons Learned Capacity Planning Scalability & Manageability Performance Tuning FY06 References Q&A

32. IT FY06 Plans 64bit Hardware & Software Windows 2003 SP1 Rollout SQL 2005 SharePoint SP2 Continue to Scale Up & Out Smart tools/WebParts to fit business scenarios Search/Index Optimization and Ranking Like OWALike OWA

33. Agenda Microsoft IT Best Practices & Lessons Learned Capacity Planning Scalability & Manageability Performance Tuning FY06 References Q&A

34. References Microsoft IT Performance White Paper http://www.microsoft.com/downloads/details.aspx?familyid=8acf3b81-2db5-4079-b904-589d2d49bedd&displaylang=en Microsoft IT SharePoint Deployment WebCast http://msevents.microsoft.com/CUI/EventDetail.aspx?EventID=1032241971&Culture=en-US Microsoft SharePoint & ISA Extranet Whitepaper http://www.microsoft.com/downloads/details.aspx?FamilyId=4C5BF9DD-3EFB-451D-B213-98ED039190BF&displaylang=en SharePoint Resource Kit http://www.microsoft.com/technet/prodtechnol/sppt/reskit/default.mspx Visit TechNet at www.microsoft.com/technet Business Benefits The key business benefits gained by Microsoft through the deployment of SharePoint Portal Server�2003 Shared Services included: Employees experienced improved productivity when they received a convenient and consistent intranet portal experience that made it easier for them to find and retrieve task-relevant knowledge and information. Systems administrators gained the ability to effectively and easily support a large world-wide intranet portal infrastructure consisting of a central intranet portal site and hundreds of business division, product group, regional and subsidiary portal sites deployed in three regional data centers Group and Division Portals Administrators of portal sites can take advantage of Shared Services that are common across a company. In general, use of services across an enterprise can reduce training costs and help desk calls. Furthermore, a Shared Services infrastructure avoids duplication of services for each portal. Network traffic created by a centralized indexing service is less than traffic created by numerous SharePoint Portal Server installations that independently crawl content. One example of the way in which Shared Services solve a business problem relates to the definition of search scopes for the collaboration platform. For example, if a group with content in one regional data center wants content and a portal hosted in that region, but also need it included in the search scope of a division portal hosted in a central data server, then they can associate it with a parent division portal and still include it in both the regional search and the divisional search for the organization. Enterprise Services The advantage of a deploying a common set of core portal services across Microsoft includes: Better decisions are made across the company when relevant information is easy for employees to find using enterprise search capabilities. Information workers are able to focus on business issues while Microsoft IT reduces costs for common portal services. Economies of scale are created for KNG and Microsoft IT because Shared Services enable them to implement shared best practices from a single central location and offer common high volume services across the global enterprise.Business Benefits The key business benefits gained by Microsoft through the deployment of SharePoint Portal Server�2003 Shared Services included: Employees experienced improved productivity when they received a convenient and consistent intranet portal experience that made it easier for them to find and retrieve task-relevant knowledge and information. Systems administrators gained the ability to effectively and easily support a large world-wide intranet portal infrastructure consisting of a central intranet portal site and hundreds of business division, product group, regional and subsidiary portal sites deployed in three regional data centers Group and Division Portals Administrators of portal sites can take advantage of Shared Services that are common across a company. In general, use of services across an enterprise can reduce training costs and help desk calls. Furthermore, a Shared Services infrastructure avoids duplication of services for each portal. Network traffic created by a centralized indexing service is less than traffic created by numerous SharePoint Portal Server installations that independently crawl content. One example of the way in which Shared Services solve a business problem relates to the definition of search scopes for the collaboration platform. For example, if a group with content in one regional data center wants content and a portal hosted in that region, but also need it included in the search scope of a division portal hosted in a central data server, then they can associate it with a parent division portal and still include it in both the regional search and the divisional search for the organization. Enterprise Services The advantage of a deploying a common set of core portal services across Microsoft includes: Better decisions are made across the company when relevant information is easy for employees to find using enterprise search capabilities. Information workers are able to focus on business issues while Microsoft IT reduces costs for common portal services. Economies of scale are created for KNG and Microsoft IT because Shared Services enable them to implement shared best practices from a single central location and offer common high volume services across the global enterprise.

35. Session Summary Establish Profile - Plan for db capacity Namespace Strategy - Few IIS Virtual Servers/Web Sites Plan Enterprise Search to avoid duplicate indexing Monitor Performance for bottlenecks

36. IT Showcase:How Microsoft Does ITCustomer-ready resources from Microsoft IT IT Showcase on TechNethttp://www.microsoft.com/technet/itshowcase/ IT Showcase on Microsoft Serviceshttp://www.microsoft.com/itshowcase/

37. Where Can I Get Help? Attend a free chat or webcast www.microsoft.com/technet/community/chats www.microsoft.com/technet/community/webcasts List of newsgroups www.microsoft.com/technet/community/newsgroups Microsoft community sites www.microsoft.com/technet/community Community events www.microsoft.com/technet/community/events Community columns www.microsoft.com/technet/community/columns KEY MESSAGE: Where to get more help SLIDE BUILDS: SLIDE SCRIPT: There are an number of community resources available on TechNet, all of them then free. You can attend a regular chat with members of the products groups or technology specialists from Microsoft or you can attend a web-cast where you can see sessions like the one you�ve just watched, but presented live and with the ability to ask questions as you go. You can also locate or post questions into the public newsgroups, the newsgroup page lists the available groups, plus provides an interface for you to read and post into. Those TechNet Plus subscribers can use these groups to post questions that through your subscription id will be answered by Microsoft within 24 hours. The main community site provides a comprehensive list of resources available, more than we can cover on this slide, plus the page has some dynamic features with continually updating content. The events page provides dates and details where you can attend a TechNet event live. These events take places worldwide and provide you the opportunity to take to Microsoft specialists face to face. And finally the TechNet Columns provide a variety of topics written by industry author. SLIDE TRANSITION: [Last slide, close however you want] KEY MESSAGE: Where to get more help SLIDE BUILDS: SLIDE SCRIPT: There are an number of community resources available on TechNet, all of them then free. You can attend a regular chat with members of the products groups or technology specialists from Microsoft or you can attend a web-cast where you can see sessions like the one you�ve just watched, but presented live and with the ability to ask questions as you go. You can also locate or post questions into the public newsgroups, the newsgroup page lists the available groups, plus provides an interface for you to read and post into. Those TechNet Plus subscribers can use these groups to post questions that through your subscription id will be answered by Microsoft within 24 hours. The main community site provides a comprehensive list of resources available, more than we can cover on this slide, plus the page has some dynamic features with continually updating content. The events page provides dates and details where you can attend a TechNet event live. These events take places worldwide and provide you the opportunity to take to Microsoft specialists face to face. And finally the TechNet Columns provide a variety of topics written by industry author. SLIDE TRANSITION: [Last slide, close however you want]

38. For More Information� Main TechNet Web site at www.microsoft.com/technet Additional resources to support this Session page can be found at www.microsoft.com/technet/tnt1-117 KEY MESSAGE: For more information on this session see these web sites. SLIDE BUILDS: SLIDE SCRIPT: For the most comprehensive technical information on Microsoft products visit the main TechNet Web site at www.microsoft.com/technet Additionally visit www.microsoft.com/technet/tnt1-117 for a more concise information on books, courses, certifications and other community resources that related directly to this particular session. SLIDE TRANSITION: What other resources are available from TechNet. KEY MESSAGE: For more information on this session see these web sites. SLIDE BUILDS: SLIDE SCRIPT: For the most comprehensive technical information on Microsoft products visit the main TechNet Web site at www.microsoft.com/technet Additionally visit www.microsoft.com/technet/tnt1-117 for a more concise information on books, courses, certifications and other community resources that related directly to this particular session. SLIDE TRANSITION: What other resources are available from TechNet.

39. Questions and Answers Submit text questions using the �Ask a Question� button. Don�t forget to fill out the survey. For upcoming and previously live webcasts: www.microsoft.com/webcasts Got webcast content ideas?E-mail us at: http://go.microsoft.com/fwlink/?LinkId=41781 Today's webcast was presented using Microsoft Office Live Meeting. Get a free 14 day trial http://www.microsoft.com/presentlive�