🏆SFEIR is the Google Cloud EMEA Training Partner of the Year 2025🤝New partnership: Official GitLab Training🤖New training: AI-Augmented Developer
🏆SFEIR is the Google Cloud EMEA Training Partner of the Year 2025🤝New partnership: Official GitLab Training🤖New training: AI-Augmented Developer
GCP200DESTREAMING

Build Streaming Data Pipelines on Google Cloud

In this course you will get hands-on in order to work through real-world challenges faced when building streaming data pipelines. The primary focus is on managing continuous, unbounded data with Google Cloud products.

You will learn about the applications and common architectural patterns for real-time data processing across key scenarios: Streaming ETL, Streaming AI/ML, Streaming Application, and Reverse ETL.

Google Cloud
✓ Official training Google CloudLevel Intermediate⏱️ 1 day (7h)

What you will learn

  • Ingest and manage streaming data using Pub/Sub and Managed Service for Apache Kafka.
  • Build and deploy streaming data pipelines with Dataflow.
  • Implement streaming data solutions for real-time analytics and application serving with BigQuery and Bigtable.

Prerequisites

  • Proficiency in a common programming language like Python
  • A strong understanding of SQL
  • Data fundamentals like data modeling, formats, and ETL/ELT processes
  • Familiarity with the Google Cloud Platform (GCP)

Target audience

  • Data Engineers, Data Analysts, Data Architects

Training Program

4 modules to master the fundamentals

Objectives
  • Introduce the course learning objectives, and the scenario that will be used to bring hands on learning to building streaming data pipelines
  • Describe the concept of streaming data pipelines, challenges associated with it, and the role of these pipelines within the data engineering process
Topics covered
  • →Fundamentals of building streaming data pipelines on Google Cloud
  • →Course learning objectives and hands-on scenario
Objectives
  • Learn about the various streaming use cases and their applications, including Streaming ETL, Streaming AI/ML, Streaming Application, and Reverse ETL
  • Identify and describe common sample architectures for streaming data
Topics covered
  • →Streaming data use cases and applications
  • →Common architectural patterns for real-time data processing
  • →Streaming ETL
  • →Streaming AI/ML
  • →Streaming Application
  • →Reverse ETL
Objectives
  • Define messaging concepts
  • Use the console to create various Pub/Sub and Kafka elements
  • Know when to use Pub/Sub or Managed Service for Apache Kafka
  • Describe the Dataflow service and challenges with streaming data
  • Build and deploy a streaming pipeline
  • Explore various data ingestion methods into BigQuery
  • Learn about BigQuery continuous queries and using BigQuery ETL and reverse ETL
  • Configure Pub/Sub to BigQuery streaming
  • Architect BigQuery into your streaming pipelines
  • Establish a streaming pipeline from Dataflow to Bigtable
  • Analyze the Bigtable continuous data stream for trends using BigQuery
  • Synchronize the trends analysis back into the user-facing application
Topics covered
  • →Messaging concepts with Pub/Sub and Managed Service for Apache Kafka
  • →Dataflow service and challenges with streaming data
  • →Building and deploying streaming pipelines
  • →Data ingestion methods into BigQuery
  • →BigQuery continuous queries and ETL/reverse ETL
  • →Pub/Sub to BigQuery streaming configuration
  • →Architecting BigQuery into streaming pipelines
  • →Streaming pipeline from Dataflow to Bigtable
  • →Analyzing continuous data streams for trends
  • →Synchronizing trends analysis back into user-facing applications
Activities

4 hands-on labs

Objectives
  • Summarize the course and what you learned about the various Google products
  • Understand what you're enabled to do next as a result of completing the course
Topics covered
  • →Comprehensive wrap-up of key concepts
  • →Building resilient and robust streaming data pipelines

Related Trainings

AWS

Advanced Architecting on AWS

In this course, each module presents a scenario with an architectural challenge to be solved. You will examine available AWS services and features as solutions to the problem. You will gain insights by participating in problem-based discussions and learning about the AWS services that you could apply to meet the challenges. Over 3 days, the course goes beyond the basics of a cloud infrastructure and covers topics to meet a variety of needs for AWS customers. Course modules focus on managing multiple AWS accounts, hybrid connectivity and devices, networking with a focus on AWS Transit Gateway connectivity, container services, automation tools for continuous integration/continuous delivery (CI/CD), security and distributed denial of service (DDoS) protection, data lakes and data stores, edge services, migration options, and managing costs. The course concludes by presenting you with scenarios and challenging you to identify the best solutions.

3 d
Advanced
AWS
Best

Architecting on AWS

Architecting on AWS is for solutions architects, solution-design engineers, and developers seeking an understanding of AWS architecting. In this course, you will learn to identify services and features to build resilient, secure, and highly available IT solutions on the AWS Cloud. Architectural solutions differ depending on industry, types of applications, and business size. AWS Authorized Instructors emphasize best practices using the AWS Well-Architected Framework, and guide you through the process of designing optimal IT solutions based on real-life scenarios. The modules focus on account security, networking, compute, storage, databases, monitoring, automation, containers, serverless architecture, edge services, and backup and recovery. At the end of the course, you will practice building a solution and apply what you have learned.

3 d
Intermediate
View all trainings →

Upcoming sessions

No date suits you?

We regularly organize new sessions. Contact us to find out about upcoming dates or to schedule a session at a date of your choice.

Register for a custom date

Quality Process

SFEIR Institute's commitment: an excellence approach to ensure the quality and success of all our training programs. Learn more about our quality approach

Teaching Methods Used
  • Lectures / Theoretical Slides — Presentation of concepts using visual aids (PowerPoint, PDF).
  • Technical Demonstration (Demos) — The instructor performs a task or procedure while students observe.
  • Guided Labs — Guided practical exercises on software, hardware, or technical environments.
Evaluation and Monitoring System

The achievement of training objectives is evaluated at multiple levels to ensure quality:

  • Continuous Knowledge Assessment : Verification of knowledge throughout the training via participatory methods (quizzes, practical exercises, case studies) under instructor supervision.
  • Progress Measurement : Comparative self-assessment system including an initial diagnostic to determine the starting level, followed by a final evaluation to validate skills development.
  • Quality Evaluation : End-of-session satisfaction questionnaire to measure the relevance and effectiveness of the training as perceived by participants.

790€ excl. VAT

per learner

ReserveQuote