Roles and Responsibilities
- Provisioning of Azure Data Platform or any Azure resource with ARM template/PowerShell/YAML scripts. Including JSON config for Databricks Cluster, nodes, drivers configuration.
- Experience in registering Azure resources in Azure Active Directory for managed identity.
- Experience in user authentication and authorization and application permissions configuring on resources, subscriptions/tenants, resource groups, etc.
- Experience in Azure CLI commands/PowerShell commands for CI/CD pipelines
- Experience in Azure DevOps, Pipelines, repos, artifacts, etc.
- Experience in configuring default Logging, Monitoring, disaster recovery backup storage settings, etc. in CLI/ARM templates for Azure Data platform resources particularly/across any Azure resource.
- Experience in writing Init scripts for Azure Databricks
- Experience in designing, building Azure Data Lake, Databricks, Data Factory (latest versions), and respective disaster recovery failover plans with primary and secondary deployments for any Azure data platform resource.
- Experience in leading and guiding DevOps team members for implementing and delivering the above responsibilities/tasks.
- Willingness to learn on the job at speed with good communication skills.
