1 / 8

An introduction to Apache S4

A short introduction to Apache S4, what is it and what is it used for ? What is its architecture ? Why was there a need to develop it ?

semtechs
Download Presentation

An introduction to Apache S4

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Apache S4 • What is it ? • Building Blocks • Characteristics • Architecture • Why was it needed ? www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  2. Apache S4 – What is it ? • S4 = SSSS • Simple Scalable Streaming System • For data processing • Aims to hide processing complexity • A platform for data processing development • Distributed • Scalable • Fault Tolerant • High performance www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  3. Apache S4 – What is it ? • It is modular • Written in Java • Currently in the Apache incubator • Offers plug-ins • For complex data stream processing • Production deployment at Yahoo www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  4. Apache S4 – Building Blocks What are the S4 building blocks ? • Message queues • Processors • Serializer • Checkpointing backend Plus • A simple API www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  5. Apache S4 – Characteristics • Cluster management uses Zoo Keeper • Symmetric nodes • No centralization • No single point of failure • No limit on nodes • Throughput increases linearly • Fault tolerant failover to standby server www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  6. Apache S4 – Architecture www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  7. Apache S4 – Why was in needed ? www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  8. Contact Us • Feel free to contact us at • www.semtech-solutions.co.nz • info@semtech-solutions.co.nz • We offer IT project consultancy • We are happy to hear about your problems • You can just pay for those hours that you need • To solve your problems

More Related