500 likes | 513 Views
Explore the latest SharePoint 2010 Search enhancements, including scale-out architecture, end-user improvements, social search features, extensibility enhancements, deployment, manageability, and FAST Search integration. Learn about search technology concepts, scaling solutions, and user interface advancements for a more powerful and efficient search experience. Discover how to maximize SharePoint's search capabilities for intranet-wide search, expertise search, visual experiences, and advanced content processing.
E N D
SharePoint 2010 Search Shikhar Thapa Senior Consultant 11/05/2010
Agenda • Scale-out Architecture • End-user Enhancements • Social Search • Extensibility Enhancements • Deployment and Manageability • FAST Search for SharePoint
Products for Every Customer Need Quick, easy, powerful search (for free!) Complete intranet search High-end search delivered through SharePoint Basic search Intranet-wide search People and expertise search • Visual experiences, extreme adaptability and advanced content processing • Powerful platform to build on • 360° customer views • Research portals • Reputation analysis • …
Search Technology Concepts Concepts Search Center - UI for users to issue queries and interact with results Query Servers- Accept query requests from users and return results OpenSearch Source Query Object Model Query Federation - Return results from non-SharePoint Indexes Query Servers Index Partition Indexing - Extract information from items to enable efficient matching Index Partition - Subset of the overall index Indexer Crawling - Traverse URL space to record items in search catalog Scaling Crawler Connectors - Know how to process different content sources Content Sources - Host the content we want to return in main results Content • Content • Content
Agenda • Scale-out Architecture • End-user Enhancements • Social Search • Extensibility Enhancements • Deployment and Manageability • FAST Search for SharePoint
MOSS 2007 Search Scale-out “The whole index” “Bottleneck” “Single point of failure” + Query “Bottleneck”
SharePoint Server 2010 Search Scale-out Multiple Indexers Stateless Crawlers Crawl Distribution Query Mirroring Index Partitioning Multiple Prop DBs “The whole index” Admin Database + Admin Component “Bottleneck” “Single point of failure” “Bottleneck”
Content Distribution • Crawl Distribution • In-built load balancer distributes hosts to crawl databases • Crawlers crawl content that is covered by crawl database • Default configuration can be overwritten using host distribution rules • E.g. purchasing a new connector • Query Distribution • Low query latency if all index partitions equal in size • Distribution by hash of documentId • Crawlers partition indexed data and propagate to query servers
Agenda • Scale-out Architecture • End-user Enhancements • Social Search • Extensibility Enhancements • Deployment and Manageability • FAST Search for SharePoint
End-User UI • Out-of-box refinement • Refine over key results properties • Metadata, taxonomy and social tags based results refinement • Easy to extend over custom properties • One-stop Search Center • Scopes, web parts, best bets, top answers , advanced search • Query federation brings together results from all over - native support for OpenSearch • Core search experience • Improved did you mean suggestions • New pre-query and post related query suggestions • “View in browser” link (for most office docs) • Improved query syntax
End-User UI • Improved relevance ranking • New ingredients for Relevance • Improved low-noise snippets in summaries • Enhanced multi-lingual support • Automatic detection of language of many document types and part of documents • Compound word handling • Improved ranking of documents in multilingual collections • New form factors • Mobile search from Smartphone browsers • Desktop search integration in Windows 7
Search Center • Site Template • Tabbed Interface • Multiple Entry-points • Keywords, Definitions, and Best Bets • Refinement Panel • Extensible
Search Usability Features Tabbed Interface Query Suggestion. One Point of Entry Best Bets/Did you Mean Improved result layout and hit-highlighting Refine by query type, and many other pivots
New Query Syntax • Support for Boolean operators for FreeText queries and property queries • (“Search” OR “SharePoint Search”) AND (title:“keyword syntax” OR title:“querysyntax”) • Prefix matching support for keywords and properties • Bench* jobtitle:Scien* • Improved operator support for property restrictions • =, >, <, <=, >= • Can create range refinements
Agenda • Scale-out Architecture • End-user Enhancements • Social Search • Extensibility Enhancements • Deployment and Manageability • FAST Search for SharePoint
Social Search • Entry from Core Results • Fuzzy name search • Self-Search • Expertise/Profile Search • Refinements
Overview of the social search system AD, LDAP, other repository User Profile Service Application Managed Metadata Service Application (Taxonomy) Search Service Application
Connect with People and Expertise Vanity search Recently authored content Phonetic and nickname matching Improved result layout and hit-highlighting Sort by relevance, name or social distance Refine by query type, and many other pivots
Agenda • Scale-out Architecture • End-user Enhancements • Social Search • Extensibility Enhancements • Deployment and Manageability • FAST Search for SharePoint
Do More with Search Common Framework, APIs, Development Tools Richer Capabilities enable search-driven applications
Browser-Based Extensibility Options • Search Web Parts • Search Box / Advanced Search • Search Summary • Search Statistics • Search Paging • Search Actions • Search Best Bets / High Confidence Results • Search Results • Search Refinement • Search Tab Pages
Search Input Web Parts • Search Box • Scope options • Additional query terms • Advanced Search Page • Search Results Page • Query Suggestion • Advanced Search • Input types • Properties (metadata) • Search Results Page
Search Utility Web Parts • Search Summary • “Did you mean” • “You searched for” • Search Statistics • Search Paging • Next / Prev Text • Next / Prev Images • Search Action Links • Determine what links to display
Search Best Bets / High Confidence Results • Same web part, different configuration • XSLT for display • Show Keywords? • Show Best Bets? • Show High Confidence Matches • Best Bet Limit
Search Core Results • Location • Results per Page • Enable removal of duplicates • Enable stemming • Selected Columns • Configurable XSLT • Scope
Search Tabs • Based off of lists in Search Center Site • Tabs in Search Pages • Tabs in Search Results • Process: • Create Entry Page • Create Results Page • Configure Web Parts on Entry and Results Page • Add Entry Page to Tabs in Search Pages • Add Results Page to Tabs in Search Results
Search Extensibility: End-User UI • Change web part properties – no code • Modify XSLT • Modify config XML • Refinement panel – control metadata available for refinement • Advanced search – control metadata available for advanced search queries • Extend OOB web parts programmatically • All OOB web parts are public • Extend web parts to change default behavior • E.g. Extend core results web part to show result previews • Extend Search Center with vertical experiences • All web parts communicate through public interface (SharedQueryManager object)
Search Extensibility - Federation • Query Federation • Bring external search results into the SharePoint experience • Based on Open Search standard • Exposed through UI + public federation object model
Search page points to Profile Page or custom page to show search result Search results page – results based on metadata Search user queries Connector Architecture Search Engine/Index BDC Profile Pages or External Lists Search BDC Runtime Execution call routing through BDC Connector using BDC model file Fetch data from repository Databases .NET BDC Connector WCF Custom BDC Connector Protocol Handlers
Agenda • Scale-out Architecture • End-user Enhancements • Social Search • Extensibility Enhancements • Deployment and Manageability • FAST Search for SharePoint
Richer Manageability • Consolidated administration UI dashboard • Automated service password management through “managed accounts” • PowerShell support for scripted administration • Built-in system health monitoring, support for SCOM monitoring and alerting • Built-in and extensible search analytics reporting
Other Engine Enhancements • Support for regular expressions in Crawl Rules • Native support for crawling case sensitive repositories • Ability to prioritize Content Sources so as to distribute crawler resources • New ‘Crawl Policy’ to define how crawler treats error conditions • Low indexing downtime Search Backups
Agenda • End-user Enhancements • Social Search • Scale-out Architecture • Extensibility Enhancements • Deployment and Manageability • FAST Search for SharePoint
Architecture Best High-End Content Search based on FAST ESP FAST Search for SharePoint Common query and federation APIs Common connectors and content APIs Content search End Users Content+ Profiles People search Unique Social Search from SharePoint Server 2010 SharePoint Server 2010
Visual, Conversational Search Sorting on any property Scrolling PowerPoint Previews Visual Best Bets Thumbnails Refinement with counts on any property Similarity Search
Content Processing and Schema Admin UI Schema CmdLets Custom Client • Extracted document attributes reported as Crawled Properties • Crawled Properties mapped to Managed Properties • Characteristics are defined for Managed Properties, e.g. • Refiners • Sorting • Queryable • Type • Definition and mapping done via UI or Powershell • Not via Central Admin Schema Object Model Update configuration Schema Service (hosted in IIS) Report discovered crawled properties Persistence Update Tools Property backend configserver bliss psctrl Alert pipeline of updated schema Document Processing Pipeline PropertiesMapper PropertiesReporter
Site Collection Scopes • Similar interface to SSP Scope Management • Organize by Display Group • Same flexibility for rules
Scope Visibility • Define Display Groups • Groups Control Visibility on Search Web Parts
Search Visibility • Control if a site shows up in search results • Sites are already security trimmed • Example: Search Center Set to “No”
Keywords & Best Bets • Use query reporting to help define keywords • Use keywords to provide access to content inaccessible to the crawler
SharePoint Server 2010 Search Major improvements over MOSS 2007
References: http://www.mssharepointconference.com/Pages/default.aspx http://www.microsoft.com/downloads/details.aspx?FamilyID=751fa0d1-356c-4002-9c60-d539896c66ce&displaylang=en Presentation Material: <MNSPUG> slide link Contact: Shikhar Thapa (sthapa@inetium.com) Q & A