Getting Started with Data Pipelines for ETL

In this session, you'll learn fundamental concepts of data pipelines, like what they are and when to use them, then you'll get hands-on experience building a simple pipeline using Python.

Feb 2024

Code along with us onCode Along

Data pipelines power data movement within an organization. Learning to combine data extraction, transformation, and loading tasks into a single pipeline is a valuable skill for any data professional!

In this session, you'll learn fundamental concepts of data pipelines, like what they are and when to use them, then you'll get hands-on experience building a simple pipeline using Python.

Key Takeaways:

Learn fundamental concepts of data pipelines and their applications.
Learn how to construct a simple data pipeline.
Learn techniques to make your data pipelines robust.

Additional Resources:

Topics

Data Engineering

DataLab

Python

tutorial

An Introduction to Data Pipelines for Aspiring Data Professionals

This tutorial covers the basics of data pipelines and terminology for aspiring data professionals, including pipeline uses, common technology, and tips for pipeline building.

Amberle McKee

22 min

tutorial

Building an ETL Pipeline with Airflow

Master the basics of extracting, transforming, and loading data with Apache Airflow.

Jake Roach

15 min

tutorial

Building Data Pipelines using R

Learn how to transform and load (ETL) a data pipeline from scratch using R and SQLite to gather tweets in real-time and store them for future analyses.