Lead Databricks Engineer - Single Customer View Location:Bournemouth (Hybrid) Contract:12-month FTC Salary:£85,000 + Benefits Lead Databricks Engineer: About the Role Join ourSingle Customer View (SCV) Programme , a strategic initiative within Financial Services aimed at delivering a unified, trusted view of customer data. We're seeking a highly skilledLead Databricks Engineerto design and implement scalable data pipelines that form the backbone of our Lakehouse platform, enabling accurate analytics, reporting, and regulatory compliance. You'll work with cutting-edge technologies includingDatabricks ,PySpark , andAzure Data Factory , applying best practices in data engineering and governance to support this critical programme. Lead Databricks Engineer: Key Responsibilities Build and maintainDatabricks pipelines(batch and incremental) using PySpark and SQL. Orchestrate end-to-end workflows withAzure Data Factory . Develop and optimiseDelta Lake tables(partitioning, schema evolution, vacuuming). ImplementMedallion Architecture(Bronze, Silver, Gold) for transforming raw data into business-ready datasets. Apply robust monitoring, logging, and error-handling frameworks. Integrate pipelines with downstream systems such asPower BI . Collaborate with analysts, business teams, and engineers to deliver consistent, well-documented datasets. Support deployments and automation viaAzure DevOps CI/CD . Gather and refine requirements from business stakeholders. Lead Databricks Engineer: About You StrongPySparkdevelopment skills for large-scale data engineering. Proven experience withDatabricks pipelinesand workflow management. Expertise inAzure Data Factoryorchestration. Solid knowledge ofDelta Lakeand Lakehouse principles. Hands-on experience withSQLfor data transformation. Familiarity withAzure services(ADLS/Blob, Key Vault, SQL). Knowledge of ETL/ELT frameworks and monitoring. Desirable: Understanding ofMicrosoft Fabric . Experience withDevOps practices(CI/CD). Awareness ofdata governance and lineage tools . Experience inFinancial Services . Rewards & Benefits 30 days' holiday + BH Competitive pension scheme Annual bonus scheme Private medical insurance + Many more About Us We're committed to building an inclusive culture and value diversity in all forms. Flexible working options are available. Please note: we cannot offer Skilled Worker Visa Sponsorship for this role. Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and perspectives. Our success is driven by our people, united by the spirit of partnership to deliver the best resourcing solutions for our clients. If you need any help or adjustments during the recruitment process for any reason,please let us know when you apply or talk to the recruiters directly so we can support you.TPBN1_UKTJ
Job Title
Lead Databricks Engineer - Single Customer View