Big Data Architect Contractor

We are seeking a Big Data Architect Contractor to design, build, and optimize large-scale data solutions on Azure and Databricks. Design, develop, and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and DatabricksBuild and tune PySpark and Spark SQL notebooks for large-scale data transformationSupport end-to-end data solutions across dev, UAT, and prod environments using Unity CatalogParticipate in technical design discussions with client architects and cross-functional counterpartsCollaborate with teams on data contracts and schema agreementsSupport the design and optimization of high-volume data pipelinesDefine and enforce engineering standards, including naming conventions, partitioning strategies, cluster configurations, and Spark tuningDrive performance optimization through AQE tuning, liquid clustering, broadcast joins, and shuffle partition managementSupport Databricks cluster policies, autoscaling configurations, and cost optimization strategiesPerform root cause analysis on production incidents and implement permanent fixesSupport junior and mid-level engineers through code reviews and pair programmingEvaluate emerging technologies and recommend adoption where relevant, such as DABs, DLT, Auto Loader, Serverless Compute, and Event HubsKey Skills Databricks - Advanced (6-9 years of experience)Strong hands-on experience with Azure Data FactoryAdvanced proficiency in Python, PySpark, and Spark SQLStrong background in big data architecture and scalable data platform designExperience with Unity Catalog and multi-environment deliveryKnowledge of Spark performance tuning and optimization techniquesExperience with cluster configuration, autoscaling, and cost managementStrong analytical and troubleshooting skills for production supportAbility to collaborate with technical teams and client stakeholdersExperience supporting engineering standards and best practicesThe expected pay range for this contract assignment is $65 - $70 per hour will vary based on skills, experience, and location and will be determined by the third-party whose employees provide services to Deloitte. Deloitte is not the employer for this role. About Deloitte

Create an account to see the full posting, access our search engine, and more.