Data Engineer - Senior Analyst
other jobs Opus Recruitment Solutions Ltd
Added before 1 Days
- England,North East,Tyne and Wear,Newcastle upon Tyne
- Full Time, Contract
- £35,000 - £55,000 per annum
Job Description:
Full job description*Build and optimise data pipelines using Java (preferred) or Python.
*Develop real-time streaming and batch data pipelines.
*Work with Kafka, Flink or Spark, with Kafka/Flink preferred.
*Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue.
*Implement data governance, lineage, security and quality controls.
*Support CI/CD using Azure DevOps, GitHub Actions or Jenkins.
*Use Terraform and Infrastructure as Code practices.
*Deploy containerised workloads using Docker, Kubernetes and AWS EKS.
*Collaborate with analytics, AI/ML, product and engineering teams.
*Develop real-time streaming and batch data pipelines.
*Work with Kafka, Flink or Spark, with Kafka/Flink preferred.
*Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue.
*Implement data governance, lineage, security and quality controls.
*Support CI/CD using Azure DevOps, GitHub Actions or Jenkins.
*Use Terraform and Infrastructure as Code practices.
*Deploy containerised workloads using Docker, Kubernetes and AWS EKS.
*Collaborate with analytics, AI/ML, product and engineering teams.
Job number 4325973
The jobs on site are for both men and women