Google BigQuery & Dagster#

Using Dagster's asset definitions and BigQuery I/O manager, you can easily interact with BigQuery tables alongside other Dagster assets.

Managing your BigQuery tables with Dagster enables you to:

• Use Python to analyze your data stored in BigQuery without writing custom SQL queries to fetch the data
• Visualize the data dependencies between tables
• Selectively update the contents of your tables
• Integrate your BigQuery tables with other tools in your data stack

BigQuery and Dagster tutorial#

In this tutorial, you'll learn how to store and load Dagster's asset definitions in BigQuery. Click here to get started.

By the end of the tutorial, you will have a connection to your BigQuery instance and a handful of assets that create tables in BigQuery or read existing tables from BigQuery.

References#