Data Pipelines

Data Pipelines are a series of data processing steps where the output of one step is the input to the next. Coursera's Data Pipelines skill catalogue teaches you how to design, build, and manage these processes for efficiently moving and transforming data from one system to another. You'll learn about different data pipeline architectures, the use of various tools and technologies such as SQL, Python, Apache Kafka, and Hadoop. You'll also understand how to handle real-time data processing, batch processing, data orchestration, and error handling within a pipeline. This skill is integral for roles like data engineers or data scientists, and anyone looking to manage large volumes of data effectively.
58credentials
232courses

Filter by

Skip to search results

Subject
Required

Language
Required

The language used throughout the course, in both instruction and assessments.

Learning Product
Required

Build job-relevant skills in under 2 hours with hands-on tutorials.
Learn from top instructors with graded assignments, videos, and discussion forums.
Learn a new tool or skill in an interactive, hands-on environment.
Get in-depth knowledge of a subject by completing a series of courses and projects.
Earn career credentials from industry leaders that demonstrate your expertise.

Level
Required

Duration
Required

Subtitles
Required

Educator
Required

Results for "data pipelines"

  • Status: Free Trial

    DeepLearning.AI

    Skills you'll gain: Apache Airflow, Data Pipelines, Data Integration, AWS Kinesis, Infrastructure as Code (IaC), Terraform, Extract, Transform, Load, Amazon CloudWatch, Data Quality, Amazon Web Services, CI/CD, Data Processing, Data Transformation, NoSQL

    4.8
    Rating, 4.8 out of 5 stars
    121 reviews

    Intermediate · Course · 1 - 4 Weeks

  • Status: Preview

    Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Business Logic, Data Processing, Real Time Data, Performance Tuning, Jupyter

    Advanced · Course · 1 - 3 Months

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Dataflow, Serverless Computing, Data Processing, Data Pipelines, Cloud Security, Identity and Access Management, Google Cloud Platform, Containerization, Data Transformation, Data Storage Technologies, Scalability

    Intermediate · Course · 1 - 3 Months

  • Status: Preview

    Board Infinity

    Skills you'll gain: Data Lakes, Data Processing, Google Cloud Platform, Data Warehousing, Data Integration, Data Management, Data Pipelines, Data Governance, Analytics, Data Quality, Data Security, Identity and Access Management, Automation

    3.3
    Rating, 3.3 out of 5 stars
    7 reviews

    Intermediate · Course · 1 - 4 Weeks

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Data Processing, Real Time Data, Extract, Transform, Load, Data Transformation, Jupyter, Google Cloud Platform, JSON, SQL

    4
    Rating, 4 out of 5 stars
    43 reviews

    Advanced · Course · 1 - 3 Months

  • Status: Preview

    SkillUp

    Skills you'll gain: Azure Synapse Analytics, Data Security, Databricks, Data Store, Data Quality, Microsoft Azure, Data Storage Technologies, Data Storage, Data Transformation, Database Management, Data Processing, Data Cleansing, Query Languages, Performance Tuning, Data Integration, Extract, Transform, Load, Data Pipelines, Apache Spark, Data Analysis

    3.9
    Rating, 3.9 out of 5 stars
    12 reviews

    Intermediate · Course · 1 - 4 Weeks

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Debugging, Data Integrity, Performance Tuning, System Monitoring, CI/CD, Unit Testing, Data Processing, Google Cloud Platform, Disaster Recovery, Integration Testing

    Advanced · Course · 1 - 3 Months

  • Status: Free Trial

    Packt

    Skills you'll gain: AWS Kinesis, Real Time Data, Apache Spark, Apache Hive, Data Pipelines, Apache Hadoop, Data Processing, Extract, Transform, Load, Amazon Web Services, Serverless Computing, Data Lakes, Data Visualization, Amazon S3, Query Languages, Performance Tuning

    Intermediate · Course · 1 - 4 Weeks

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Dataflow, Serverless Computing, Identity and Access Management, Data Pipelines, Google Cloud Platform, Cloud Security, Data Processing, Data Security, Cloud Storage, Data Storage Technologies, Containerization

    4.2
    Rating, 4.2 out of 5 stars
    92 reviews

    Intermediate · Course · 1 - 3 Months

  • Status: Free Trial

    IBM

    Skills you'll gain: Data Warehousing, SQL, Extract, Transform, Load, Apache Airflow, Linux Commands, Database Design, IBM Cognos Analytics, MySQL, Database Administration, Data Pipelines, Apache Kafka, Database Management, Bash (Scripting Language), Shell Script, Database Architecture and Administration, Data Store, IBM DB2, Data Visualization, Relational Databases, Dashboard

    4.7
    Rating, 4.7 out of 5 stars
    6.5K reviews

    Beginner · Professional Certificate · 3 - 6 Months

  • Status: Free Trial

    Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Apache Kafka, Real Time Data, Extract, Transform, Load, Data Processing, SQL, Google Cloud Platform, Analytics, Jupyter

    Advanced · Course · 1 - 3 Months

  • Google Cloud

    Skills you'll gain: Real Time Data, Dataflow, Data Pipelines, Dashboard, Google Cloud Platform, Data Processing, Data Transformation, Scalability

    4.1
    Rating, 4.1 out of 5 stars
    15 reviews

    Intermediate · Course · 1 - 3 Months

Related roles

Gain the knowledge and skills you need to advance.

View all

  • Data Engineer

    This role has a £62,784 median salary ¹.

    Data Engineer

    description:

    A Data Engineer builds data pipelines for large datasets, optimizing systems and ensuring reliable data flow using tools like Hadoop and Spark.

    This role has a £62,784 median salary ¹.

    Offered by

    DeepLearning.AI_logo
    Amazon Web Services_logo
    Google Cloud_logo

  • Data Warehouse Developer

    This role has a £52,272 median salary ¹.

    Data Warehouse Developer

    description:

    A Data Warehouse Developer designs and optimizes data warehouses, ensuring efficient storage and retrieval for analytics using ETL processes.

    This role has a £52,272 median salary ¹.

    Offered by

    IBM_logo
    Vanderbilt University_logo
View all

Most popular

Trending now

New releases

What brings you to Coursera today?

Leading partners

  • Google Cloud
  • IBM
  • EDUCBA
  • Whizlabs
  • Duke University
  • Packt
  • DeepLearning.AI
  • Microsoft