Session
Secure Databricks Automation with PowerShell: Identity, Jobs, CI/CD, and Guardrails
Many Databricks automation examples show how to call an API or trigger a job. Enterprise teams need more than that. They need secure identity, least privilege, environment separation, CI/CD integration, repeatable deployment, and operational guardrails that work across real teams and real production constraints.
This deep dive shows how to design a secure PowerShell-driven automation framework for Databricks. We will start with identity: user login for local development, service principals for unattended automation, OAuth-based authentication, and safe handling of configuration and secrets. Then we will move into job and workflow operations: triggering runs, checking status, handling failures, collecting outputs, and producing audit-friendly logs.
The second half focuses on CI/CD and platform governance. We will show how PowerShell can work alongside Databricks CLI, Declarative Automation Bundles, GitHub Actions, Azure DevOps, and REST APIs to validate environments, enforce naming standards, check workspace readiness, and support deployment promotion across dev, test, and production.
Attendees will leave with a practical pattern for secure Databricks automation that reduces manual work without turning every script into a security risk.
Mou Rakshit
Avanade, Intelligent Data Platform Data Engineering Thought leadership
Northville, Michigan, United States
Links
Please note that Sessionize is not responsible for the accuracy or validity of the data provided by speakers. If you suspect this profile to be fake or spam, please let us know.
Jump to top