Skip to main content

course

Streamlined Data Ingestion with pandas

Intermediate

4.5+

Updated 12/2024

Learn to acquire data from common file formats and systems such as CSV files, spreadsheets, JSON, SQL databases, and APIs.

Start course for free

Included for FreePremium or Teams

PythonData Preparation4 hours16 videos53 exercises4,500 XP53,056Statement of Accomplishment

Create Your Free Account

Google LinkedIn Facebook

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.

Training 2 or more people?

Try DataCamp for Business

Loved by learners at thousands of companies

Course Description

Before you can analyze data, you first have to acquire it. This course teaches you how to build pipelines to import data kept in common storage formats. You’ll use pandas, a major Python library for analytics, to get data from a variety of sources, from spreadsheets of survey responses, to a database of public service requests, to an API for a popular review site. Along the way, you’ll learn how to fine-tune imports to get only what you need and to address issues like incorrect data types. Finally, you’ll assemble a custom dataset from a mix of sources.

Prerequisites

Intermediate Python Intermediate SQL

1

Importing Data from Flat Files

Introduction to flat files

Get data from CSVs

Get data from other flat files

Modifying flat file imports

Import a subset of columns

Import a file in chunks

Handling errors and missing data

Specify data types

Set custom NA values

Skip bad data

2

Importing Data From Excel Files

Introduction to spreadsheets

Get data from a spreadsheet

Load a portion of a spreadsheet

Getting data from multiple worksheets

Select a single sheet

Select multiple sheets

Work with multiple spreadsheets

Modifying imports: true/false data

Set Boolean columns

Set custom true/false values

Modifying imports: parsing dates

Parse simple dates

Get datetimes from multiple columns

Parse non-standard date formats

3

Importing Data from Databases

Introduction to databases

Connect to a database

Load entire tables

Refining imports with SQL queries

Selecting columns with SQL

Selecting rows

Filtering on multiple conditions

More complex SQL queries

Getting distinct values

Counting in groups

Working with aggregate functions

Loading multiple tables with joins

Joining tables

Joining and filtering

Joining, filtering, and aggregating

4

Importing JSON Data and Working with APIs

Introduction to JSON

Load JSON data

Work with JSON orientations

Introduction to APIs

Get data from an API

Set API parameters

Set request headers

Working with nested JSONs

Flatten nested JSONs

Handle deeply nested data

Combining multiple datasets

Concatenate dataframes

Merge dataframes

Streamlined Data Ingestion with pandas

Course
Complete

Earn Statement of Accomplishment

Add this credential to your LinkedIn profile, resume, or CV
Share it on social media and in your performance review

Included withPremium or Teams

Don’t just take our word for it

*4.5

from 17 reviews

71%

24%

0%

0%

6%

Highest to Lowest
Lowest to Highest
Most recent
Top reviews

Luis P.

3 months

Very useful

Vickie Z.

7 months

Highly recommended to everyone!

Faria C.

11 months

This course has many useful tips for handling type conversions such as datetimes and booleans. The chapter on parsing nested JSON from an API is very helpful, and I have already put it to use.

Carsten H.

11 months

Awesome tutorial and challenging code tasks

Lorenzo A.

11 months

Good

"Very useful"

Luis P.

"Highly recommended to everyone!"

Vickie Z.

"This course has many useful tips for handling type conversions such as datetimes and booleans. The chapter on parsing nested JSON from an API is very helpful, and I have already put it to use."

Faria C.

Join over 15 million learners and start Streamlined Data Ingestion with pandas today!

Create Your Free Account

Google LinkedIn Facebook

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.