140 likes | 225 Views
** PySpark Certification Training: https://www.edureka.co/pyspark-certification-training ** <br>This Edureka video will provide you with a comprehensive and detailed knowledge of Dataframes, and how to use Dataframes in PySpark. Below are the topics covered in the video: <br><br>1. Need for Dataframes <br>2. What are Dataframes <br>3. Dataframes Features <br>4. Sources of Dataframes <br>5. Hands On - Pyspark Dataframes
E N D
PySpark Dataframe Tutorial PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
Today’s Training Topics Today’s Training Topics ❖ Need for Dataframes ❖ What are Dataframes ❖ Dataframes Features ❖ Sources of Dataframes ❖ Demo PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
Why do we need Why do we need Dataframes Dataframes? ? Processing Structured And Semi-Structured Data PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
Why do we need Why do we need Dataframes Dataframes? ? Handling Petabytes of Data Processing Structured And Semi-Structured Data PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
Why do we need Why do we need Dataframes Dataframes? ? Handling Petabytes of Data Processing Structured And Semi-Structured Data Wide Range of Data Formats and Sources PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
Why do we need Why do we need Dataframes Dataframes? ? Handling Petabytes of Data Support for Multiple Languages Processing Structured And Semi-Structured Data Wide Range of Data Formats and Sources PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
What are What are Dataframes Dataframes? ? 2d labelled Data Structure Similar to SQL PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
Features of Features of Dataframes Dataframes Lazy EVALs Distributed Immutable PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
Creating a Dataframe(Sources) Creating a Dataframe(Sources) Dataframe PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
Important Classes Important Classes • pyspark.sql.SQLContext • pyspark.sql.DataFrame • pyspark.sql.Column • pyspark.sql.Row • pyspark.sql.GroupedData • pyspark.sql.DataFrameNaFunctions • pyspark.sql.DataFrameStatFunctions • pyspark.sql.functions • pyspark.sql.types • pyspark.sql.Window PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
CREATING DATAFRAMES DEMO PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
FIFA WORLD CUP FIFA WORLD CUP – – USE CASE USE CASE FIFA world Cup Use Case PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training
SUPERHEROS Use Case PYSPARK CERTIFICATION TRAINING www.edureka.co/pyspark-certification-training