1 / 17

Apache Sqoop Tutorial | Sqoop: Import & Export Data From MySQL To HDFS | Hadoop Training | Edureka

** Hadoop Training: https://www.edureka.co/hadoop ** <br>This Edureka PPT on Sqoop Tutorial will explain you the fundamentals of Apache Sqoop. It will also give you a brief idea on Sqoop Architecture. In the end, it will showcase a demo of data transfer between Mysql and Hadoop <br>Below topics are covered in this video: <br><br>1. Problems with RDBMS <br>2. Need for Apache Sqoop <br>3. Introduction to Sqoop <br>4. Apache Sqoop Architecture <br>5. Sqoop Commands <br>6. Demo to transfer data between Mysql and Hadoop <br><br>Check our complete Hadoop playlist here: https://goo.gl/hzUO0m <br><br>Follow us to never miss an update in the future. <br>Instagram: https://www.instagram.com/edureka_learning/ <br>Facebook: https://www.facebook.com/edurekaIN/ <br>Twitter: https://twitter.com/edurekain <br>LinkedIn: https://www.linkedin.com/company/edureka

EdurekaIN
Download Presentation

Apache Sqoop Tutorial | Sqoop: Import & Export Data From MySQL To HDFS | Hadoop Training | Edureka

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Topics to be covered… 1 Problems with RDBMS 2 Need for Sqoop 3 Introduction to Sqoop 4 Features of Sqoop 5 Sqoop Architecture 6 Sqoop Commands & Demo using MySQL Copyright © 2017, edureka and/or its affiliates. All rights reserved.

  2. Problems with Relational Database RDBMS Data Importing was Tedious task Difficult to handle large datasets Time Consuming Task Cant store Unstructured Data Copyright © 2017, edureka and/or its affiliates. All rights reserved.

  3. Need for Sqoop Data Analysis Command Line Interface High Performance Copyright © 2017, edureka and/or its affiliates. All rights reserved.

  4. What is Sqoop? Tool used to transfer bulk data between HDFS & Relational Database Servers Import RDBMS HDFS Copyright © 2017, edureka and/or its affiliates. All rights reserved.

  5. What is Sqoop? Tool used to transfer bulk data between HDFS & Relational Database Servers HDFS RDBMS Export Copyright © 2017, edureka and/or its affiliates. All rights reserved.

  6. Features of Sqoop Full Load Data loading directly to HIVE Incremental Load Parallel Import/Export Kerberos Security Integration Compression Copyright © 2017, edureka and/or its affiliates. All rights reserved.

  7. Sqoop Architecture Copyright © 2017, edureka and/or its affiliates. All rights reserved.

  8. How Sqoop Import & Export Works? Copyright © 2017, edureka and/or its affiliates. All rights reserved.

  9. Sqoop Commands

  10. Sqoop Import Command IMPORT Import EXPORT Import each table of the RDBMS in Hadoop LIST DATABASE LIST TABLES $ sqoop import \ --connect jdbc:mysql://<ip address>/<database name> --table <mysql_table name> CODEGEN --username <username_for_mysql_user> --password <Password> --target-dir <target directory where data needs to be imported>

  11. Sqoop Export Command IMPORT Export EXPORT Exports data from HDFS to RDBMS LIST DATABASE LIST TABLES $ sqoop export \ --connect jdbc:mysql://<ip address>/<database name> --table <mysql_table name> CODEGEN --username <username_for_mysql_user> --password <Password> --export-dir <directory name where data needs to be exported>

  12. Sqoop List Database IMPORT Sqoop EXPORT It lists the databases present in the relational database LIST DATABASE LIST TABLES $ sqoop list databases --connect jdbc:mysql://<ip address>/<database name> CODEGEN --table <mysql_table name> --username <username_for_mysql_user> --password <Password>

  13. Sqoop List Tables ID 1 2 3 Name Jino Neha Chaitra Age 25 22 23 Address Kottayam Dharwad Bangalore IMPORT EXPORT It lists the available tables in the database LIST DATABASE LIST TABLES $ sqoop list tables --connect jdbc:mysql://<ip address>/<database name> CODEGEN --table <mysql_table name> --username <username_for_mysql_user> --password <Password>

  14. Sqoop Codegen Generates DAO Class automatically Generates Java Class file Source code can be recreated IMPORT EXPORT LIST DATABASE LIST TABLES $ sqoop codegen --connect jdbc:mysql://<ip address>/<database name> CODEGEN --table <mysql_table name> --username <username_for_mysql_user> --password <Password>

More Related