Company:
CV-Library
Location: Leeds
Closing Date: 12/10/2024
Salary: £40,000 - £55,000 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description
Financial Services firm looking for a heavy hitting Data engineer where some of your Key Responsibilities will include:
* Develop new pipelines based on business needs or to improve the current system.
* Maintain existing data pipelines, anticipating and addressing issues promptly and professionally.
* Monitor critical processes effectively.
* Collaborate with various business units to define project requirements for pipelines and ETL.
Essential Skills and Qualifications
* Technical Proficiency: Expertise in SQL (Postgres, Athena Presto SQL) and proficiency in Python for building and managing data pipelines.
* AWS Experience: Skilled in using serverless architecture, including Lambda, Glue, Step Functions, SNS, SQS, and S3.
* Data Engineering Expertise: Over 2 years of experience in data engineering, creating data pipelines in a cloud environment, with a solid understanding of best practices.
* Effective Communication: Ability to clearly convey and gather requirements from non-technical business stakeholders.
* Deployment and Documentation: Proficient in controlled deployment and documentation practices using GitHub, ensuring changes are tested, approved, and easily understood by all.
Desirable Skills
* Infrastructure Automation: Experience with Terraform for new infrastructure and CloudFormation for legacy systems.
* iPaaS Knowledge: Familiarity with Integration Platform as a Service, particularly MuleSoft, is a plus
Share this job
CV-Library
Useful Links