1 / 26

AWS

AWS. Amazon Web Services. Georges Akpoly CS252. Overview of AWS. Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Simple Queue Service (SQS) Amazon Mechanical Turk (MTurk) Alexa Web Services Amazon E-Commerce Service (ECS)

zenia-chang
Download Presentation

AWS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. AWS Amazon Web Services Georges Akpoly CS252

  2. Overview of AWS • Amazon Elastic Compute Cloud (EC2) • Amazon Simple Storage Service (S3) • Amazon Simple Queue Service (SQS) • Amazon Mechanical Turk (MTurk) • Alexa Web Services • Amazon E-Commerce Service (ECS) • Amazon Flexible Payments Service (FPS)

  3. Starting Point One machine: • Apache, IIS • PHP / Perl / Java / … • SQL Server, MySQL, Oracle

  4. Worst Case Populariy

  5. A Difficult Path

  6. Problem: Backup • High availability • Redundancy • Very big data sets

  7. Problem: File System • Important files have to be accessed by many servers • NFS / Samba not practical

  8. Problem: Messaging • Many servers on different locations have to communicate • Creating a reliable and scalable message queue is really hard

  9. Don’t reinvent the wheel!

  10. Amazon Web Services

  11. S3 - Simple Storage Service • Redundant storage - as much as you like • max. 5 GB per object • Organized in “Buckets” • Web Service API for uploads • Downloads via • Web Service • HTTP / HTTPS • BitTorrent

  12. S3 - Buckets • Unique over all S3 • Contains many key-value-metadata tupel • Cannot contain other buckets! • Key can contain “/”

  13. S3 with AWS::S3 • Upload • Download

  14. S3 with AWS::S3 • How do you run a website from S3 • #1 caveat: no index.html support • So it’s only useful to offload traffic and storage from your main site

  15. S3 with AWS::S3 • Set up a bucket name ‘vanlug’ • Store a key in it ‘tux.png’ • Make it publicly accessible • Set up a CName ‘static.vanlug.com’ and points it to ‘vanlug.s3.amazonaws.com’ • Load up http://static.vanlug.com/tux.png • That’s it.

  16. S3 with AWS::S3 • JungleDisk • This application lets you mount S3 like it is a local drive • Cross platform, support linux, Mac, Windows • Encryption can be pre or post upload.

  17. EC2 - Elastic Compute Cloud • Based on XEN virtualization • On demand virtual servers - controlled with Web Service API • Use your favorite Linux distro (Linux 2.6.16), Amazon Machine Images (AMI) are stored on S3 • ACLs for hosts/ports access control

  18. EC2 - Elastic Compute Cloud • How much does it cost • Traffic between EC2 instances and S3 is free. Even if they are not in the same datacenter • $0.10 per instance-hour consumed ( or part of an hour consumed) • Same prices for traffic and storage as S3

  19. EC2 - Elastic Compute Cloud • What you can do with it • You are the root, do anything • Install software • Apache • VPN • UT2004, Call of Duty • Jabber • Load kernel modules

  20. SQS - Simple Queue Service • Distributed, highly scalable and reliable message system • Unlimited number of queues and messages • Locking / releasing built-in • 256 KB message payload • Basic permission model

  21. SQS gem Setup Usage

  22. MTurk • Amazon uses Artificial Artificial Intelligence • Submitters enter Human Intelligence tasks into the queue and workers can solve them • Workers can be tested for capabilities before they are trusted • Submitters can refuse results if they find them unsatisfactory • There are feedback system in place so Workers can know if the submitters will pay

  23. MTurk • Some examples • Podcast transcription services • Image recognition for mapping service • Amazon has used it themselves for internal projects

  24. Resources • Developer Connection http://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=59 • Forums http://developer.amazonwebservices.com/connect/forumindex.jspa • Resource Center http://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=59 • 265,000+ developers

  25. Questions???

  26. Thank you for your attention

More Related