Spark: PySpark
Learn PySpark from basics in this free online tutorial. PySpark is taught hands-on by experts. Gain skills to work with Spark MLlib, RDD, data frames, and clustering with case studies for structured and semi-structured data.
Ratings
Level
Learning hours
Learners
Skills you’ll Learn
About this Course
The PySpark course begins by giving you an introduction to PySpark and will further discuss examples to explain it. Moving further, you will gain expertise working with Spark libraries, like MLlib. Next, in this PySpark tutorial, you will learn to move RDD to Dataframe API and become familiar with Clustering in PySpark. The course also comprehends a case study to help you gain hands-on on the learned topics.
Adding value to your learning experience, the Introduction to PySpark course is taught by an industry expert. A quiz is assigned to test your gains at the end of the course. Complete the quiz and gain a course completion certificate.
To expand your learning in the Data Science domain, consider pursuing Data Science certificate courses that offer specialization/electives to escalate your career.
Course Outline
This section gives a clear overview of how Spark contributes to Hadoop, and the Spark framework. It explains PySpark with examples and code demonstrations.
This section discusses the Machine Learning library supported by Spark. It then explains ML pipelines, Transformers, Estimator, and architecture. You will also gain an understanding of K-means and Tf-ldf through hands-on code demonstrations.
You will understand Spark dataframes, and SQL. You will gain enough experience to understand why you need to shift from RDD to dataframe API while working with Data Science and Big Data tasks through demonstrated code samples.
This section will explain k-means clustering in MLlib and TFID, most commonly used in neural networks, with demonstrated code.
This section demonstrates a case study on the Music dataset to understand the aforementioned topics with hands-on experience.
Share your certificate & get noticed
What our learners enjoyed the most
Skill & tools
67% of learners found all the desired skills & tools