Databricks has recently released an SDK for performing tasks such as creating workspaces and authoring clusters, a long-awaited piece of tooling to make DevOps for Databricks easier. Prior to this, when performing CI/CD DevOps tasks, we have been restricted to using the Databricks CLI or REST API. Both have their merits but there has been a longing for an SDK that will allow for those CI/CD DevOps tasks to be easily written in Python, the most commonly used programming language by Databricks users.

In this session, we will explore the SDK and how it compares to the traditional CLI and REST API. We will look at what we can and can’t do, where we may need to drop into using the traditional methods, and how easy that is to do.

By the end of the session, you will have a better understanding of the SDK, including where its strengths are and what features we still eagerly await.