370 likes | 542 Views
Amazon CloudSearch Technical Overview Advanced AWS Meetup Jon Handler Amazon CloudSearch Solutions Architect October 3, 2012. Welcome. Housekeeping Introduction To Amazon CloudSearch Search Basics Hands-on With Amazon CloudSearch Keith Mitchell from Reddit.
E N D
Amazon CloudSearch Technical OverviewAdvanced AWS MeetupJon HandlerAmazon CloudSearch Solutions ArchitectOctober 3, 2012
Welcome • Housekeeping • Introduction To Amazon CloudSearch • Search Basics • Hands-on With Amazon CloudSearch • Keith Mitchell from Reddit
Key Benefits Of The Cloud Low Variable Pricing Pay Only for What You Use No Up-Front Capital Expense Improve Agility & Time to Market Self-Service Infrastructure Easily Scale Up and Down Deploy
Search • Search is becoming ubiquitous • Has a steep learning curve • Is complex to operate • With expensive licenses, support, consulting • Resulting in a long time to market But…
Amazon CloudSearch Solutions • Easy to Set Up • Easy to Integrate • Hands-off Operation with Automatic Scaling • Up and Running in an Hour • Pay-As-You-Go
Inverted Index US President
Search On The Web Relevance/Ranking Faceting Range Searching Fielded Searching Boolean Queries Complex Relevance
Search On The Web Relevance/Ranking Faceting Range Searching Fielded Searching Boolean Queries Complex relevance
Search On The Web Relevance/Ranking Faceting Range Searching Fielded Searching Boolean Queries Complex relevance
Search On The Web Relevance/Ranking Faceting Range Searching Fielded Searching Boolean Queries Complex relevance
Search On The Web Relevance/Ranking Faceting Range Searching Fielded Searching Boolean Queries Complex relevance
Search On The Web Relevance/Ranking Faceting Range Searching Fielded Searching Boolean Queries Complex relevance
Search On The Web Relevance/Ranking Faceting Range-Searching Fielded Searching Boolean Queries Complex Relevance
Easy To Integrate SEARCH CLIENT SEARCH DEVELOPER www.example.com Send Search Requests Send Documents Create and Manage Domains Use the Search Tester Search Results SEARCH ENDPOINT DOCUMENT SERVICE ENDPOINT CONFIGURATION SERVICE ENDPOINT Configuration API Command Line Tools Document Service API Command Line Tools Console Search API Console Console SEARCH SERVICE DOCUMENT SERVICE CONFIGURATION SERVICE Add Documents Search Documents Create Domains Update Documents Configure Domains Delete Documents Delete Domains ACCESS CONTROL ACCESS CONTROL ACCESS CONTROL
Hands-Off Operation DATA Document Quantity and Size SEARCH INSTANCE Index Partition 1 Copy 1 SEARCH INSTANCE SEARCH INSTANCE SEARCH INSTANCE Index Partition n Copy 1 Index Partition 2 Copy 1 Index Partition 1 Copy 1 TRAFFIC Search Request Volume and Complexity SEARCH INSTANCE SEARCH INSTANCE SEARCH INSTANCE Index Partition 2 Copy 2 Index Partition 1 Copy 2 Index Partition n Copy 2 SEARCH INSTANCE SEARCH INSTANCE SEARCH INSTANCE Index Partition n Copy n Index Partition 1 Copy n Index Partition 2 Copy n
Use Case • Million song dataset http://labrosa.ee.columbia.edu/millionsong/ • Search documents are songs • Attributes: title, artist names, years, genre, artist familiarity • We’ll use this to create a “Build Your Playlist” web application.
SDF Documents [ {"type":"add", "id": "sombzze12a8c134960", "version":5, "lang":"en", "fields": {"title":"Cajun Twisters", "artist_name":"Adam Ant", "year":"1993", "song_id":"sombzze12a8c134960", "artist_familiarity":449425, "genre":["alternative", "electronic", "instrumental", "rock"] } }, … ]
Configuration • Automatic (Console) • Command-line as well
Send Queries (Console)
PHP Integration $results = file_get_contents( http://search-mn-songs-5bbplyghbb5tk257rsb7iamlsy." . "us-east-1.cloudsearch.amazonaws.com" . "/2011-02-01/search?q=" . $keyword . $bqParam . "&return-fields=title,artist_name,year,genre_result,artist_familiarity&". "facet=year_facet,genre&" . "facet-year_facet-sort=alpha&" . "facet-genre-sort=alpha&" . "facet-genre-top-n=100000&" . "facet-year_facet-top-n=100000&" . "t-year=1985..&" . "t-title=a..&" . "rank=-" . $rank); $resultsObj = json_decode($results);
Getting Started • Amazon CloudSearch Overview Page http://aws.amazon.com/cloudsearch/ • Community Forum • FAQ, Documentation & Getting Started Tutorial (IMDb) • Demos and Tutorials • Introducing Amazon CloudSearch (Features) • Getting Started Tutorial
Upcoming Events Las Vegas, November 27-29 • https://reinvent.awsevents.com/ • Enterprise Search Summit/KMworld, DC, Oct. 17-19 • Bay Area Amazon CloudSearch Group: Oct. 24