Skip to main content

Connections

Early access preview

This feature is in preview phase and is available in Dagster+ in limited early access. Functionality and APIs may change as we continue development. To get early access to this feature, reach out to your Dagster account team. For more information, see the API lifecycle stages documentation.

Connections allow you to easily discover and sync data warehouse assets from sources like Snowflake, BigQuery, Postgres, and Databricks into Dagster. These assets are viewable in the Dagster UI catalog, and you can set alerts on schema changes or metadata values (like row count).

Supported data warehouses​

Connections currently supports the following data warehouse types, which each have their own configuration guide:

Monitoring Connections assets with alerts​

You can use alerts to monitor two kinds of changes to your Connections assets: schema changes, or metadata changes.

  1. Navigate to Deployment > Alerts and click Create alert policy.
  2. Select Asset as the alert type.
  3. Set the target to a "Custom Selection" with group: NAME_OF_YOUR_CONNECTION.
  4. Then select Table schema changes or Metrics as the event type, and complete the rest of the configuration.

About the asset definitions created from Connections​

The assets created by a Connection are independent from existing Dagster definitions, and use the name of your Connection as both the group name and code location name.

Currently, metadata on assets from Connections does not impact code-defined assets, even if they point to the same underlying data warehouse table (though this may change in the future).