🏆SFEIR is the Google Cloud EMEA Training Partner of the Year 2025🤝New partnership: Official GitLab Training🤖New training: AI-Augmented Developer
🏆SFEIR is the Google Cloud EMEA Training Partner of the Year 2025🤝New partnership: Official GitLab Training🤖New training: AI-Augmented Developer
GCP200DATAFORM

Orchestrate BigQuery Workloads with Dataform

Dataform is a service for data analysts to develop, test, version control, and schedule complex SQL workflows for data transformation in BigQuery. In this course you will explore the components of Dataform core, learn how to define tables and dependencies in SQLX, document BigQuery tables and views, understand BigQuery security settings and how to manage these with Dataform, write assertions, execute SQL workflows, and explore additional advanced use cases.

Google Cloud
✓ Official training Google CloudLevel Intermediate⏱️ 1 day (7h)

What you will learn

  • Document BigQuery tables and views.
  • Understand BigQuery security settings using Dataform.
  • Use assertions to validate data in Dataform workflows.
  • Execute Dataform SQL workflows in an automated fashion.

Prerequisites

  • Knowledge of SQL data analysis and BigQuery as discussed in BigQuery for Data Analysis.

Target audience

  • Customers

Training Program

7 modules to master the fundamentals

Objectives
  • Understand the components of Dataform core.
Topics covered
  • →SQL workflow
  • →Repositories and workspaces
  • →Default files and folders
  • →Compiled graphs
Objectives
  • Create tables and views in BigQuery using Dataform.
Topics covered
  • →Declare a data source.
  • →Create a table.
  • →Create an incremental table.
  • →Set partitioning and clustering options.
  • →Create an empty table.
  • →Create an external BigLake table.
  • →Create views and materialized views.
  • →Define dependencies.
Objectives
  • Document BigQuery tables and views.
Topics covered
  • →Use column descriptions.
  • →Use globally defined JavaScript constants.
  • →Add labels.
Activities

Lab: Build SQL Workflows with Dependencies in Dataform

Objectives
  • Understand BigQuery security settings using Dataform.
Topics covered
  • →IAM dataset and table/view access
  • →Column-level security
  • →Row-level security
Objectives
  • Use assertions to validate data in Dataform workflows.
Topics covered
  • →Use built-in assertions.
  • →Create manual assertions.
Activities

Lab: Work with Assertions and BigQuery Security Settings in Dataform

Objectives
  • Execute Dataform SQL workflows in an automated fashion.
Topics covered
  • →Dataform code lifecycle.
  • →What happens during compilation.
  • →Customize and schedule compilation results.
  • →Execute workflows (UI, Cloud Scheduler, Cloud Composer).
  • →Logging and monitoring.
Activities

Lab: Automate and Monitor SQL Workflow Executions in Dataform

Objectives
  • Explore additional use cases for Dataform.
Topics covered
  • →Create a BigLake table after file upload using Cloud Run functions.
  • →Build a Machine Learning pipeline with BigQuery ML.
  • →Work with Slowly Changing Dimensions Type 2.
Activities

Lab: Create a BigLake Table with Dataform Using Cloud Run Functions

Related Trainings

Google Cloud

Data Warehousing with BigQuery: Storage Design, Query Optimization, and Administration

In this course, you learn about the internals of BigQuery and best practices for designing, optimizing, and administering your data warehouse. Through a combination of lectures, demos, and labs, you learn about BigQuery architecture and how to design optimal storage and schemas for data ingestion and changes. Next, you learn techniques to improve read performance, optimize queries, manage workloads, and use logging and monitoring tools. You also learn about the different pricing models. Finally, you learn various methods to secure data, automate workloads, and build machine learning models with BigQuery ML.

3 d
Intermediate
Google Cloud

Build Data Lakes and Data Warehouses with Google Cloud

In this course, you will learn to differentiate data architectures and implement data lakehouse and pipeline concepts on Google Cloud. You will compare and contrast data lake, data warehouse, and data lakehouse architectures, and evaluate the benefits of the modern lakehouse approach. Get hands-on experience building a data lakehouse with Cloud Storage, open formats like Apache Iceberg, and BigQuery as the central processing engine. Learn about data governance, security, and advanced analytics patterns for your unified data platform.

1 d
Intermediate
View all trainings →

Upcoming sessions

No date suits you?

We regularly organize new sessions. Contact us to find out about upcoming dates or to schedule a session at a date of your choice.

Register for a custom date

Quality Process

SFEIR Institute's commitment: an excellence approach to ensure the quality and success of all our training programs. Learn more about our quality approach

Teaching Methods Used
  • Lectures / Theoretical Slides — Presentation of concepts using visual aids (PowerPoint, PDF).
  • Technical Demonstration (Demos) — The instructor performs a task or procedure while students observe.
  • Guided Labs — Guided practical exercises on software, hardware, or technical environments.
  • Quiz / MCQ — Quick knowledge check (paper-based or digital via tools like Kahoot/Klaxoon).
Evaluation and Monitoring System

The achievement of training objectives is evaluated at multiple levels to ensure quality:

  • Continuous Knowledge Assessment : Verification of knowledge throughout the training via participatory methods (quizzes, practical exercises, case studies) under instructor supervision.
  • Progress Measurement : Comparative self-assessment system including an initial diagnostic to determine the starting level, followed by a final evaluation to validate skills development.
  • Quality Evaluation : End-of-session satisfaction questionnaire to measure the relevance and effectiveness of the training as perceived by participants.

790€ excl. VAT

per learner

ReserveQuote