Data Pipelines

Data Pipelines are a series of data processing steps where the output of one step is the input to the next. Coursera's Data Pipelines skill catalogue teaches you how to design, build, and manage these processes for efficiently moving and transforming data from one system to another. You'll learn about different data pipeline architectures, the use of various tools and technologies such as SQL, Python, Apache Kafka, and Hadoop. You'll also understand how to handle real-time data processing, batch processing, data orchestration, and error handling within a pipeline. This skill is integral for roles like data engineers or data scientists, and anyone looking to manage large volumes of data effectively.
58credentials
232courses

Filter by

Skip to search results

Subject
Required

Language
Required

The language used throughout the course, in both instruction and assessments.

Learning Product
Required

Build job-relevant skills in under 2 hours with hands-on tutorials.
Learn from top instructors with graded assignments, videos, and discussion forums.
Learn a new tool or skill in an interactive, hands-on environment.
Get in-depth knowledge of a subject by completing a series of courses and projects.
Earn career credentials from industry leaders that demonstrate your expertise.

Level
Required

Duration
Required

Subtitles
Required

Educator
Required

Results for "data pipelines"

  • Google Cloud

    Skills you'll gain: MongoDB, Dataflow, Applied Machine Learning, Google Cloud Platform, Data Pipelines, Big Data, Data Integration

    Intermediate · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Apache Airflow, Tensorflow, MLOps (Machine Learning Operations), Google Cloud Platform, Data Pipelines, Machine Learning Methods, Cloud Computing, Machine Learning

    1.3
    Rating, 1.3 out of 5 stars
    7 reviews

    Beginner · Project · Less Than 2 Hours

  • Google Cloud

    Skills you'll gain: Data Loss Prevention, Personally Identifiable Information, Data Pipelines, Cloud-Based Integration, Cloud Storage, Data Security, Data Integration, Data Management, Data Transformation, Cloud Management, DevOps

    Advanced · Project · Less Than 2 Hours

  • Status: New
    Status: Free Trial

    LearnKartS

    Skills you'll gain: AWS Kinesis, Amazon Redshift, Real Time Data, Data Processing, Data Pipelines, Serverless Computing, Apache Spark, Data Visualization, Big Data, Amazon Web Services, Advanced Analytics, Performance Tuning, Extract, Transform, Load, Amazon CloudWatch, Amazon S3, Data Transformation, Scalability

    Intermediate · Course · 1 - 4 Weeks

  • Status: New
    Status: Free Trial

    Coursera Instructor Network

    Skills you'll gain: Apache Kafka, Data Warehousing, Extract, Transform, Load, Microsoft SQL Servers, Snowflake Schema, Star Schema, Performance Tuning, Data Pipelines, Cloud Computing Architecture, Business Intelligence, Real Time Data, Apache Hadoop, Data Modeling, Data Quality, Responsible AI, Apache Spark, SQL, Generative AI, Data Governance, Quality Management

    4.3
    Rating, 4.3 out of 5 stars
    81 reviews

    Intermediate · Specialization · 1 - 3 Months

  • Status: New
    Status: Free Trial

    EDUCBA

    Skills you'll gain: Extract, Transform, Load, Metadata Management, Data Integration, Data Pipelines, Databases, Business Logic, Java, Data Warehousing, File Management, Data Cleansing, Data Import/Export, Data Migration, Data Manipulation, Scalability, Data Transformation, Software Documentation, Software Installation, Data Processing, MySQL, Debugging

    Beginner · Specialization · 1 - 3 Months

  • Status: New
    Status: Free Trial

    Packt

    Skills you'll gain: Apache Kafka, Apache Spark, Apache Hadoop, Scala Programming, Real Time Data, Apache Hive, Command-Line Interface, Distributed Computing, Data Processing, Big Data, Apache, Apache Cassandra, Applied Machine Learning, Data Pipelines, Java, Databases, MongoDB, IntelliJ IDEA, NoSQL, Application Deployment

    4.5
    Rating, 4.5 out of 5 stars
    12 reviews

    Intermediate · Specialization · 3 - 6 Months

  • Status: New
    Status: Free Trial

    EDUCBA

    Skills you'll gain: Extract, Transform, Load, Apache Spark, Data Pipelines, PySpark, Apache Hadoop, Data Transformation, MySQL, Data Manipulation, Java Platform Enterprise Edition (J2EE), Data Store, Data Import/Export, Development Environment, Software Installation, System Configuration

    Mixed · Course · 1 - 4 Weeks

  • Status: Free Trial

    Packt

    Skills you'll gain: Databricks, CI/CD, Apache Spark, Microsoft Azure, Data Governance, Data Lakes, Data Architecture, Real Time Data, PySpark, Data Pipelines, Data Integration, Data Management, Automation, Data Storage, System Testing, Data Processing, Jupyter, Data Quality, User Provisioning, File Systems

    4.3
    Rating, 4.3 out of 5 stars
    23 reviews

    Intermediate · Specialization · 1 - 3 Months

  • Status: Free Trial

    IBM

    Skills you'll gain: Exploratory Data Analysis, Data Wrangling, Data Transformation, Data Analysis, Data Cleansing, Data Manipulation, Data Import/Export, Predictive Modeling, Regression Analysis, Statistical Analysis, Pandas (Python Package), Scikit Learn (Machine Learning Library), Data-Driven Decision-Making, Matplotlib, Feature Engineering, Data Visualization, Data Pipelines, NumPy, Python Programming

    4.7
    Rating, 4.7 out of 5 stars
    19K reviews

    Intermediate · Course · 1 - 3 Months

  • Status: Free Trial

    Snowflake

    Skills you'll gain: Data Engineering, Data Manipulation, Data Lakes, Data Warehousing, Cloud Development, SQL, Data Pipelines, Extract, Transform, Load, Application Development, Artificial Intelligence and Machine Learning (AI/ML), Role-Based Access Control (RBAC), Stored Procedure, Data Storage, Database Management, LLM Application, Generative AI, Data Science, Machine Learning

    4.8
    Rating, 4.8 out of 5 stars
    161 reviews

    Beginner · Course · 1 - 4 Weeks

  • Google Cloud

    Skills you'll gain: Dataflow, Data Pipelines, Data Transformation, Extract, Transform, Load, Data Processing, Google Cloud Platform, Serverless Computing, Big Data, Apache Spark, Apache Hadoop, Cloud Storage, Performance Tuning

    Intermediate · Course · 1 - 3 Months

Related roles

Gain the knowledge and skills you need to advance.

View all

  • Data Engineer

    This role has a £62,784 median salary ¹.

    Data Engineer

    description:

    A Data Engineer builds data pipelines for large datasets, optimizing systems and ensuring reliable data flow using tools like Hadoop and Spark.

    This role has a £62,784 median salary ¹.

    Offered by

    DeepLearning.AI_logo
    Amazon Web Services_logo
    Google Cloud_logo

  • Data Warehouse Developer

    This role has a £52,272 median salary ¹.

    Data Warehouse Developer

    description:

    A Data Warehouse Developer designs and optimizes data warehouses, ensuring efficient storage and retrieval for analytics using ETL processes.

    This role has a £52,272 median salary ¹.

    Offered by

    IBM_logo
    Vanderbilt University_logo
View all

Most popular

Trending now

New releases

What brings you to Coursera today?

Leading partners

  • Google Cloud
  • IBM
  • EDUCBA
  • Whizlabs
  • Duke University
  • Packt
  • DeepLearning.AI
  • Microsoft