Databricks Integration

Integration of Databricks with the Data Mesh Manager.

Data Product Registration

Databricks Asset Bundles (DABs) are the new format to bundle data products on Databricks. They contain all files necessary to run a data product on Databricks, including the code and the configuration. We've extended the standard open source template for a Databricks Asset Bundle with the Data Mesh Manager integration. Our extended template automatically registers the data product with its data contract at the Data Mesh Manager through our REST Api.

# Create a new Databricks Asset Bundle using the Data Mesh Manager template
databricks bundle init https://github.com/datamesh-manager/databricks-bundle-python-template