Job Title: Lead Data Engineer Job Description We are looking to build a greenfield team to create a new data platform. Currently, we are in a proof of concept/prototype phase, testing various tools to understand their capabilities. The goal is to ensure efficient connection to different data sources, effective monitoring, and alerting. This will improve efficiency and enable better integration with third parties using similar tools. We need a Lead Data Engineer to guide the team and set standards for frameworks, best practices, and documentation.
Responsibilities *Lead the development team by example and upskill others.
*Set standards for development frameworks, best practices, and documentation.
*Collaborate with ETL Developers, Architects, and Infrastructure teams.
*Ensure effective documentation and understanding of development patterns.
*Consult and work closely with the team to ensure a suitable development environment.
*Understand and guide monitoring and logging practices, although hands-on Terraform work will be handled by the infrastructure team.
Essential Skills *Experience with AWS (Step Functions, Glue, Lambdas, EventBridge)
*Proficiency in Python
*Strong background in SDLC and Data Platform experience
Additional Skills & Qualifications *Experience with New Relic and Sumo Logic
*Familiarity with CI/CD tools (Terraform, Github)
*Experience with Snowflake
*Agile working practices, particularly Kanban (they work in 2-week sprints)
Why Work Here? Our company offers a fully remote role with the potential for occasional travel to the Newcastle office, providing opportunities for collaboration and upskilling the team. We offer agile working practices in a large tech company environment.
Work Environment This role is fully remote, with the potential for occasional travel to the Newcastle office. The initial contract is for 3 months, with scope to extend beyond. The team works in 2-week sprints using Agile and Kanban practices.
Job Type & Location This is a Contract position based out of Newcastle Upon Tyne, United Kingdom.
Location Newcastle upon Tyne, UK
Trading as TEKsystems. Allegis Group Limited, Maxis 2, Western Road, Bracknell, RG12 1RT, United Kingdom. No. 2876353. Allegis Group Limited operates as an Employment Business and Employment Agency as set out in the Conduct of Employment Agencies and Employment Businesses Regulations 2003. TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands. If you apply, your personal data will be processed as described in the Allegis Group Online Privacy Notice available at https://en-gb/privacy-notices.
To access our Online Privacy Notice, which explains what information we may collect, use, share, and store about you, and describes your rights and choices about this, please go to https://en-gb/privacy-notices.
We are part of a global network of companies and as a result, the personal data you provide will be shared within Allegis Group and transferred and processed outside the UK, Switzerland and European Economic Area subject to the protections described in the Allegis Group Online Privacy Notice. We store personal data in the UK, EEA, Switzerland and the USA. If you would like to exercise your privacy rights, please visit the "Contacting Us" section of our Online Privacy Notice at https://en-gb/privacy-notices for details on how to contact us. To protect your privacy and security, we may take steps to verify your identity, such as a password and user ID if there is an account associated with your request, or identifying information such as your address or date of birth, before proceeding with your request. If you are resident in the UK, EEA or Switzerland, we will process any access request you make in accordance with our commitments under the UK Data Protection Act, EU-U.S. Privacy Shield or the Swiss-U.S. Privacy Shield.