Senior Databricks Engineer

About the Role

We are seeking an experienced Senior Databricks Engineer to join a high-profile client project. This is an excellent opportunity for a skilled data engineering professional with strong expertise in Azure technologies and Microsoft Fabric to design and deliver modern cloud-based data platforms.

Working as part of an experienced delivery team, you will build scalable, high-performance data solutions that support business intelligence, analytics, and enterprise reporting.

Location

Location: UK (Remote/Hybrid – Client Requirement)

Contract Type

Contract Type: Contract

Experience Required

Experience Required: 5+ Years

SC Clearance

SC Clearance: Not Required

Key Responsibilities

• Design, develop, and maintain enterprise-scale data pipelines using Azure Databricks.
• Build robust ETL/ELT solutions using Azure Data Factory and Microsoft Fabric.
• Develop high-performance data processing solutions using Python, PySpark, and SQL.
• Implement Delta Lake and Lakehouse architectures following industry best practices.
• Work with Azure Data Lake Storage (ADLS Gen2) to manage large-scale datasets.
• Optimise Spark workloads for performance, scalability, and cost efficiency.
• Design and implement data models to support reporting and analytics.
• Integrate datasets with Power BI for business reporting and visualisation.
• Implement CI/CD pipelines using Azure DevOps and Git.
• Collaborate with architects, business analysts, and stakeholders to deliver technical solutions.
• Troubleshoot production issues and continuously improve platform performance.

Required Skills & Experience

Why Join Us?

• Opportunity to work on enterprise-scale Azure data projects
• Latest Microsoft Azure and Fabric technologies
• Collaborative and supportive delivery team

#J-18808-Ljbffr