Full job descriptionSenior Data Engineer - Databricks - London (Hybrid) - Up to £80,000
We’re partnering with a fast-growing analytics and data business operating across the entertainment sector. As demand for real-time insight and advanced analytics continues to scale, the company is investing heavily in a modern, cloud-native data platform, with Databricks at its core.
This role is ideal for a Senior Data Engineer who wants true end-to-end ownership: designing, building, deploying and operating production-grade data systems, while shaping engineering standards and CI/CD practices across the platform.


The Role
You’ll play a key role in building and evolving a high-performance Databricks lakehouse platform, taking ownership from ingestion through to production deployment.
Key responsibilities include:
*Design, build and operate end-to-end data pipelines using Databricks
*Own and evolve Databricks architecture across batch, streaming and event-driven workloads
*Implement and mature CI/CD pipelines for data engineering (testing, deployment, versioning)
*Develop reusable, production-ready data frameworks and patterns
*Drive engineering best practice across performance, security, reliability and cost optimisation
*Lead technical design decisions and influence long-term data platform strategy
*Mentor other engineers and raise overall data engineering standards
This is a hands-on role with genuine architectural influence, not a people-management-only position.


Key Experience & Capabilities
We’re specifically looking for strength in modern data engineering, not just analytics or reporting.
Core requirements:
*Strong experience delivering end-to-end data engineering solutions in production
*Deep hands-on expertise with Databricks (jobs, notebooks, workflows, Delta Lake)
*Experience designing and operating CI/CD pipelines for data platforms
*Strong Python & SQL skills for scalable data processing
*Solid understanding of lakehouse architecture and the Medallion (Bronze/Silver/Gold) pattern
*Strong data modelling experience (star/snowflake schemas, SCD Types 1-3)
*Experience with streaming and event-driven architectures
*Performance tuning and cost optimisation in cloud data platforms
*Experience with data quality, observability and data contracts
Nice to have (but not essential):
*dbt, Snowflake or similar analytics engineering tooling
*Experience supporting ML or advanced analytics workloads
*Exposure to data mesh or domain-oriented data platforms


What’s on Offer
*Up to £80,000 salary
*Join a scaling, well-funded business with serious technical ambition
*Work on a modern Databricks-centric data platform
*High impact role with ownership of architecture, CI/CD and engineering standards
*Clear opportunity to influence how data engineering is done across the organisation


Interested
If you’re a Senior Data Engineer who wants real ownership of Databricks, end-to-end pipelines and shape a modern data platform from the ground up.
Apply Now!