Seeking a Technical Lead Data Engineer,
Initial 12 Month contract and the position will require weekly visits to site in London.

Responsibilities:
*Lead the design, development, and implementation of data engineering solutions for our data Lakehouse platform.
*Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
*Provide technical leadership, mentoring, and coaching to the data engineering team.
*Ensure best practices in data engineering, including data modeling, ETL processes, and data quality.
*Manage CI/CD pipelines using Azure DevOps or Git.
*Develop and maintain event-driven pipelines using .NET and other relevant technologies.

Skills and requirements:


*Extensive experience with Databricks, Apache Spark, and data lakes.
*Proficiency in Python and SQL.
*Experience with CI/CD processes using Azure DevOps or Git.
*Knowledge of streaming data technologies such as Kafka and KSQL DB.
*Familiarity with reporting tools like Power BI and Qlik.
*Software engineering experience with .NET for event-driven pipelines and automation testing.
*Experience with Databricks Unity Catalog.
*Strong skills in data modeling, including Snowflake modeling, star schema modeling, and other techniques.
*Ability to optimize big data workloads in Spark.
Michael Bailey International is acting as an Employment Business in relation to this vacancy.