Senior Cloud Engineer, Databricks Platform - Hybrid or Remote#26-08983

About the role

Senior Cloud Engineer – Databricks Platform (5‑month contract) responsible for designing, building, and operating the Azure data and AI platform for a major insurance company, owning infrastructure‑as‑code, networking, security, data lake, Data Factory, Azure ML, observability, FinOps, and establishing Databricks platform standards while partnering with data engineering and data science teams.

About the company

Genesis10 is a top‑ranked U.S. staffing firm that places consultants and employees in contract, contract‑to‑hire, and permanent roles for over 300 clients, including Fortune 100 and mid‑market organizations across many industries.

Requirements

• 6+ years of cloud infrastructure or platform engineering experience, with at least 4 years focused on Microsoft Azure.
• Expert‑level hands‑on Terraform experience, including production module authoring, remote state management, and CI/CD integration.
• Demonstrable hands‑on Databricks administration experience (account/workspace, Unity Catalog, cluster policies, identity federation, cost governance).
• Proven ability to act as senior technical partner to adjacent teams, translating business requests into platform solutions and building consensus.
• Deep knowledge of Azure networking and security (private endpoints, VNets, hub‑spoke design, NSGs, Entra ID, managed identities, RBAC, Key Vault).
• Expertise in ADLS Gen2 design and enterprise‑scale access control.
• Platform‑side experience with Azure Data Factory integration runtimes, managed VNet, credential management, and deployment automation.
• Strong scripting/programming skills in Python and PowerShell and/or Bash for tooling and automation.
• Working knowledge of Spark and SQL sufficient to diagnose infrastructure and configuration performance issues.
• Ability to work directly as a Genesis10 employee (no third‑party contractors).
• Experience with Databricks Asset Bundles, Terraform Databricks provider, and workspace‑as‑code patterns (preferred).
• Led Unity Catalog migrations or multi‑workspace consolidations (preferred).
• Experience with Azure Machine Learning, MLflow, or model‑serving infrastructure (preferred).
• Kubernetes/AKS and containerized workload experience (preferred).
• Policy‑as‑code experience (Azure Policy, OPA, Sentinel, Checkov) (preferred).
• Event‑driven infrastructure experience (Event Hubs, Kafka, Stream Analytics) (preferred).
• Formal FinOps practice experience (preferred).
• Experience with multi‑region or multi‑tenant Databricks deployments (preferred).
• Databricks Certified Data Engineer Professional or Databricks platform administrator credential (preferred certification).
• Microsoft Certified: Azure Solutions Architect Expert (AZ‑305) (preferred certification).
• Microsoft Certified: Azure Administrator Associate (AZ‑104) (preferred certification).
• Microsoft Certified: DevOps Engineer Expert (AZ‑400) (preferred certification).
• HashiCorp Certified: Terraform Associate (preferred certification).