senior data engineer
other jobs Lorien Resourcing Limited
Added before 3 Days
- England,London,City of London
- Full Time, Permanent
- Salary negotiable
Job Description:
Principle Data Engineer
We are currently recruiting for a Principle Data Engineer with experience working on enterprise scale data platforms to join one of our Insurance clients on a 6-month contract.
Inside IR35
Hybrid- Adhoc
*Own and evolve the target architecture for enterprise data platforms across Systems of Record and Analytical Platforms, translating it into deliverable engineering work
*Produce solution designs, patterns, and working examples (e.g., sample pipelines, reference notebooks) covering.
*Act as a technical authority on architectural trade offs, helping teams balance timeliness, consistency, resilience, simplicity, and cost
*Create, document, and help implement engineering standards and best practices (through templates, CI/CD checks, and working examples) for:
*Lead platform modernisation by evaluating, adopting, and migrating to newer, more cost effective Microsoft first capabilities; retire legacy or over engineered ETL approaches and decommission redundant components
*Promote AI driven development practices (e.g., AI assisted code generation, test creation, documentation, and refactoring) with appropriate guardrails around security, correctness, and maintainability
*Enable integration with AI platforms by shaping data products for AI use cases and defining patterns for secure access to enterprise data
*System of Record and Analytical Platform Boundaries
*Define consistent patterns for how Systems of Record expose data for analytical consumption
*Ensure Analytical Platforms provide trusted, explainable representations of enterprise data
Experience
*Significant hands on experience designing, building, and operating enterprise scale data platforms using Microsoft first cloud technologies.
*Able to deliver independently in a contractor context: shape work from problem statements, manage priorities, and drive to production outcomes with minimal
*Hands-on experience with relevant data platform services and technologies, such as SQL (e.g., SQL Server/Azure SQL), Microsoft Fabric (Lakehouse/Warehouse, Data Factory), and Databricks (Spark)
*Advanced SQL skills and experience working with complex datasets
*Demonstrated ability to simplify and rationalise existing architectures
*Comfortable working across multiple teams and stakeholder groups with varying priorities
*Experience with modern data engineering practices such as version control, CI/CD, automated testing, and infrastructure-as-code
*Experience integrating data platforms with AI services and tools (e.g., Azure OpenAI or equivalent), including secure data access patterns for analytics and AI workloads
*Working knowledge of a general-purpose programming language used in data engineering (e.g., Python) and scripting/automation
*Strong awareness of security, access control, and governance concepts for enterprise data platforms
Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.
We are currently recruiting for a Principle Data Engineer with experience working on enterprise scale data platforms to join one of our Insurance clients on a 6-month contract.
Inside IR35
Hybrid- Adhoc
*Own and evolve the target architecture for enterprise data platforms across Systems of Record and Analytical Platforms, translating it into deliverable engineering work
*Produce solution designs, patterns, and working examples (e.g., sample pipelines, reference notebooks) covering.
*Act as a technical authority on architectural trade offs, helping teams balance timeliness, consistency, resilience, simplicity, and cost
*Create, document, and help implement engineering standards and best practices (through templates, CI/CD checks, and working examples) for:
*Lead platform modernisation by evaluating, adopting, and migrating to newer, more cost effective Microsoft first capabilities; retire legacy or over engineered ETL approaches and decommission redundant components
*Promote AI driven development practices (e.g., AI assisted code generation, test creation, documentation, and refactoring) with appropriate guardrails around security, correctness, and maintainability
*Enable integration with AI platforms by shaping data products for AI use cases and defining patterns for secure access to enterprise data
*System of Record and Analytical Platform Boundaries
*Define consistent patterns for how Systems of Record expose data for analytical consumption
*Ensure Analytical Platforms provide trusted, explainable representations of enterprise data
Experience
*Significant hands on experience designing, building, and operating enterprise scale data platforms using Microsoft first cloud technologies.
*Able to deliver independently in a contractor context: shape work from problem statements, manage priorities, and drive to production outcomes with minimal
*Hands-on experience with relevant data platform services and technologies, such as SQL (e.g., SQL Server/Azure SQL), Microsoft Fabric (Lakehouse/Warehouse, Data Factory), and Databricks (Spark)
*Advanced SQL skills and experience working with complex datasets
*Demonstrated ability to simplify and rationalise existing architectures
*Comfortable working across multiple teams and stakeholder groups with varying priorities
*Experience with modern data engineering practices such as version control, CI/CD, automated testing, and infrastructure-as-code
*Experience integrating data platforms with AI services and tools (e.g., Azure OpenAI or equivalent), including secure data access patterns for analytics and AI workloads
*Working knowledge of a general-purpose programming language used in data engineering (e.g., Python) and scripting/automation
*Strong awareness of security, access control, and governance concepts for enterprise data platforms
Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.
Job number 3723379
Increase your exposure to recruiters with ProJobs
Thousands of recruiters are looking for you in the Job Master profile database, increase your exposure 4 times with a ProJob subscription
You can cancel your subscription at any time.
metapel
Company Details:
Lorien Resourcing Limited
Lorien is a global technology recruitment solutions specialist, with over 40 years? industry experience. By immersing ourselves in industry trends, wo...