Data Engineer
other jobs Trust In Soda
Added before 2 Days
- England,London
- full-time
- £700 - £768 per day
Job Description:
Data Engineer - HIRING ASAP
Start date: ASAP
Duration: 12 Months
Location: Hybrid Working in London office
Rate: £700-£768 per day inside IR35
Summary
The International Engineering team is responsible for building and running the UK and Canadian apps. As a Data Engineer, you will own engineering efforts to provide partner teams within the organisation with data sources that build our AI/ML user experience and help run our client robustly and at scale.
Responsibilities:
*Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow;
*Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness;
*Build critical data quality checks to ensure that the data we process and provide to partner teams meets security and compliance requirements;
*Participate in code and technical design reviews;
*Scope and plan work together with product engineering, data science and the business; support other teams for all tasks related to data tracking, collection, ingestion, quality monitoring and alerting.
Skills:
*Python is a MUST HAVE
*Data Pipelining
*Airflow
*SQL
*BigQuery
*Data Warehousing
Start date: ASAP
Duration: 12 Months
Location: Hybrid Working in London office
Rate: £700-£768 per day inside IR35
Summary
The International Engineering team is responsible for building and running the UK and Canadian apps. As a Data Engineer, you will own engineering efforts to provide partner teams within the organisation with data sources that build our AI/ML user experience and help run our client robustly and at scale.
Responsibilities:
*Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow;
*Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness;
*Build critical data quality checks to ensure that the data we process and provide to partner teams meets security and compliance requirements;
*Participate in code and technical design reviews;
*Scope and plan work together with product engineering, data science and the business; support other teams for all tasks related to data tracking, collection, ingestion, quality monitoring and alerting.
Skills:
*Python is a MUST HAVE
*Data Pipelining
*Airflow
*SQL
*BigQuery
*Data Warehousing
Job number 1711523
metapel
Company Details:
Trust In Soda
We invest in our people and our wider community to reflect our core values - depth of knowledge and strong long-term relationships. We enjoy building ...