This role will own the architectural blueprint for a unified Lakehouse ingestion, transformation, governance, and serving, that powers analytics, data engineering, and AI/ML across the organization. Platform Architecture: Own the reference architecture for the Azure + Databricks Lakehouse — medallion design, Delta Lake standards, and Unity Catalog and multi-workspace topology.Cross-Functional IT Partnership: Partner with enterprise IT — cloud infrastructure, network engineering, and security teams — to co-design landing zones, connectivity, and platform guardrails aligned to enterprise standards and shared services.Vendor & Managed Service Oversight: Provide architectural direction and quality governance to managed service providers and system integrators; define standards and acceptance criteria, review deliverables, set and monitor SLAs, and hold partners accountable to the reference architecture and security controls.CI/CD & Automation: Establish Infrastructure-as-Code and CI/CD standards (Azure DevOps / GitHub Actions, Terraform, Databricks Asset Bundles) for repeatable, governed delivery across environments.Performance & Cost Optimization (FinOps): Drive tuning and cost-efficiency across compute, pipelines, and SQL workloads; embed FinOps discipline, tagging, and chargeback.Innovation & Continuous Improvement: Run proofs-of-concept, pilot emerging Azure/Databricks capabilities (including Microsoft Fabric), and evolve architecture patterns to improve performance, cost, and capability.Standards & Leadership: Define and enforce architecture governance and best practices; lead design and architecture reviews; and shape the platform’s multi-year roadmap. We want you to have Bachelor’s degree in Computer Science, Information Systems, or related field.5+ years in data engineering, data platform engineering, or cloud data architecture with architecture ownership at scale, including 3+ years architecting solutions on Azure Databricks.Strong expertise in Apache Spark / PySpark, Delta Lake, and Databricks Lakehouse architecture, including Unity Catalog governance and Databricks administration (provisioning, RBAC, cluster policies, security controls).Excellent communication, stakeholder management, and technical leadership skillsDatabricks certifications (e.g., Certified Data Engineer Professional/Associate) and/or Microsoft Azure certifications (Azure Data Engineer, Azure Solutions Architect Expert),preferred. Why You’ll Love Building Your Career at Altria
Create an account to see the full posting, access our search engine, and more.You're just 60 seconds away from your new Creativeloft account.