120 likes | 650 Views
A introduction to zeppelin, what does it do and what is it used for ? How can it be used with Spark ?<br><br><br>http://www.semtech-solutions.co.nz<br><br>http://www.amazon.com/Michael-Frampton/e/B00NIQDOOM/ref=dp_byline_cont_book_1<br><br>https://nz.linkedin.com/pub/mike-frampton/20/630/385
E N D
Apache Zeppelin • What is Zeppelin ? • How does it work • How can it be used • Available interpreters • Major uses ? • See zeppelin.incubator.apache.org • Books www.semtech-solutions.co.nz info@semtech-solutions.co.nz
Zeppelin – What is it ? • Data visualisation • Notebook based • Aids collaboration • Open sourced – Apache 2 license • Has many interpreters • Many display options • Is extensible www.semtech-solutions.co.nz info@semtech-solutions.co.nz
Zeppelin – How does it work ? • Collaborative notebooks to access data • Select interpreter to manipulate data • i.e. Spark SQL • Use visualisation options to present data • Create reports and dashboards • Share dashboards to the web / customers www.semtech-solutions.co.nz info@semtech-solutions.co.nz
Zeppelin – How can it be used ? • Select data from the file system / HDFS • Use Spark + NoSQL connector • Collaborate, share notebook session • Use Markdown for session comments • Filter data via interpreters i.e Scala , SQL • Visualise data with graphs, reports, dashboards • Share results www.semtech-solutions.co.nz info@semtech-solutions.co.nz
Zeppelin – Interpreters • Shell • Spark • Tajo • Build your own ! • Cassandra • Elasticsearch • Flink • Geode • Hive • Ignite • Lens • Markdown • Postgresql, Hawq • Scalding www.semtech-solutions.co.nz info@semtech-solutions.co.nz
Zeppelin – Major uses ? • Who are the major users ? • Databricks • Big data stack developers • Hortonworks • Data investigation, discovery and sharing • Extensible • Add your own interpreters • Add your own graphs www.semtech-solutions.co.nz info@semtech-solutions.co.nz
Zeppelin – Example - SQL with variable shows pie chart www.semtech-solutions.co.nz info@semtech-solutions.co.nz
Zeppelin – Example - SQL with variable shows bar chart www.semtech-solutions.co.nz info@semtech-solutions.co.nz
Available Books • See “Big Data Made Easy” • Apress / Springer Jan 2015 • See “Mastering Apache Spark” • Packt Oct 2015 www.semtech-solutions.co.nz info@semtech-solutions.co.nz
Contact Us • Feel free to contact us at • www.semtech-solutions.co.nz • info@semtech-solutions.co.nz • We offer IT project consultancy • We are happy to hear about your problems • You can just pay for those hours that you need • To solve your problems