1 / 7

An Introduction to Apache Oozie

An Introduction to Apache Oozie, what is it and what is it used for ? How is it used with Hadoop ?

semtechs
Download Presentation

An Introduction to Apache Oozie

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Apache Oozie • What is it ? • Why use it ? • Architecture • Examples www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  2. Oozie – What is it ? • Work flow scheduler for Hadoop • Manages Hadoop Jobs • Integrated with many Hadoop apps i.e. Pig • Scaleable • Schedule jobs • A work flow is a collection of actions i.e. • map/reduce, pig, hfs • A work flow is • Arranged as a DAG ( direct acyclic graph )‏ • Graph stored as hPDL ( XML process definition )‏ www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  3. Oozie – Why use it ? • It is designed for Hadoop • It is open source • It is designed for big data • It allows you to design task work flow • It allows you to interact with jobs • Stop, start, suspend, resume, rerun www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  4. Oozie – Architecture www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  5. Oozie – Architecture • Install Oozie on edge node / not on cluster • Oozie has client • Launches jobs and talks to server • Ozzie has server • Controls jobs • Launches jobs • Pipelines • Chained workflows • Work flow output • Is input to next www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  6. Oozie – Architecture www.semtech-solutions.co.nz info@semtech-solutions.co.nz

  7. Contact Us • Feel free to contact us at • www.semtech-solutions.co.nz • info@semtech-solutions.co.nz • We offer IT project consultancy • We are happy to hear about your problems • You can just pay for those hours that you need • To solve your problems

More Related