Skip to main content
HomePython
skill track

Big Data with PySpark

Advance your data skills by mastering Apache Spark. Using the Spark Python API, PySpark, you will leverage parallel computation with large datasets, and get ready for high-performance machine learning. From cleaning data to creating features and implementing machine learning models, you'll execute end-to-end workflows with Spark. The track ends with building a recommendation engine using the popular MovieLens dataset and the Million Songs dataset.

PythonClock25hrsLearn6 coursesApply1 projectTrophyStatement of Accomplishment

Create Your Free Account

GoogleLinkedInFacebook

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.
Group

Training 2 or more people?

Try DataCamp for Business

Loved by learners at thousands of companies

1
Introduction to PySpark

Learn to implement distributed data management and machine learning in Spark using the PySpark package.

4 hours

Lore Dirick Headshot

Lore Dirick

Director of Data Science Education at Flatiron School

2
Big Data Fundamentals with PySpark

Learn the fundamentals of working with big data with PySpark.

4 hours

Upendra Kumar Devisetty Headshot

Upendra Kumar Devisetty

Science Analyst at CyVerse

3
Cleaning Data with PySpark

Learn how to clean data with Apache Spark in Python.

4 hours

Mike Metzger Headshot

Mike Metzger

Data Engineer Consultant @ Flexible Creations

4
Feature Engineering with PySpark

Learn the gritty details that data scientists are spending 70-80% of their time on; data wrangling and feature engineering.

4 hours

John Hogue Headshot

John Hogue

Lead Data Scientist, General Mills

5
Machine Learning with PySpark

Learn how to make predictions from data with Apache Spark, using decision trees, logistic regression, linear regression, ensembles, and pipelines.

4 hours

Andrew Collier Headshot

Andrew Collier

Data Scientist @ Exegetic Analytics

6
Building Recommendation Engines with PySpark

Learn tools and techniques to leverage your own big data to facilitate positive experiences for your users.

4 hours

Jamen Long Headshot

Jamen Long

Data Scientist

7
Building a Demand Forecasting Model

Use PySpark to build an e-commerce forecasting model!

2 hours

Caroline Barbosa Headshot

Caroline Barbosa

Senior Data Scientist

Sparkles AI ASSISTANTSign up to use the AI AssistantOur AI assistant is free to use for all registered users. Sign up or login to access the assistant and boost your learning experience.
Discover
For Business

Training 2 or more people?

Get your team access to the full DataCamp platform, including all the features.
DataCamp for BusinessFor a bespoke solution book a demo.

Instructors

  • Lore Dirick Headshot
    Lore DirickDirector of Data Science Education at Flatiron SchoolSee Lore Dirick's Portfolio
  • Nick Solomon Headshot
    Nick SolomonData ScientistSee Nick Solomon's Portfolio
  • Upendra Kumar Devisetty Headshot
    Upendra Kumar DevisettyScience Analyst at CyVerseSee Upendra Kumar Devisetty's Portfolio
  • Mike Metzger Headshot
    Mike MetzgerData Engineer Consultant @ Flexible CreationsSee Mike Metzger's Portfolio

FAQs

Join over 15,140,000 learners and start Big Data with PySpark today!

Create Your Free Account

GoogleLinkedInFacebook

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.