Full job descriptionAWS Data Engineer (Active SC)
Full time/ perm
Our client is seeking Security Cleared AWS Data Engineers at all levels to design, build, and support scalable cloud-based data solutions. You will develop robust data pipelines, automate workflows, and deliver secure, high-performance data platforms using AWS-native technologies.
Key Responsibilities
*Develop and maintain data pipelines using Python, SQL, and Apache Airflow.
*Build and manage containerised data applications using Docker.
*Design and optimise solutions using AWS services including Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
*Implement CI/CD pipelines using GitLab or similar tools.
*Monitor, troubleshoot, and improve data pipeline performance and reliability.
*Collaborate with cross-functional teams to deliver secure and scalable data platforms.
*Ensure adherence to data governance, security, and best practice standards.
Essential Skills
*Active Security Clearance
*Strong experience with Python and SQL.
*Hands-on experience with Apache Airflow and Docker.
*Proven experience with AWS data services, including Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
*Experience with Git, GitLab, and CI/CD pipelines.
*Understanding of AWS security best practices, IAM, and RBAC.
Desirable Skills
*Experience with Athena, SQS, CloudWatch, CloudTrail, or EMR.
*Knowledge of Terraform or CloudFormation.
*Experience in consultancy or client-facing environments.
Personal Attributes
*Strong problem-solving and troubleshooting skills.
*Excellent communication and stakeholder management abilities.
*Collaborative approach and experience working in Agile teams.
*Proactive mindset with a focus on continuous improvement.