Senior Data Engineer

Senior Data Engineer London, Birmingham, Remote Salary up to £65,000 per annum An exciting opportunity has arisen to join a global organisation within the Assurance space. As the new Senior Data Engineer you will play a pivotal role within the Data team of the Digital and Information Function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data. Key responsibilities include: Ownership and delivery of the design, development and maintenance of highly scalable and robust data pipelines and workflows utilising Azure Data Factory and Databricks. Lead data transformation and integration efforts to augment data from diverse sources, ensuring data governance and regulatory compliance throughout the process. Establish and enforce data quality standards through the implementation of rigorous data validation processes, ensuring the utmost accuracy, completeness, and consistency of the data ecosystem. Serve as a key liaison between cross-functional teams, including data scientists, analysts, and business stakeholders, to comprehensively understand data requirements, conduct User Acceptance Testing (UAT), and deliver tailored solutions that align with business objectives. Proactively monitor pipeline performance, swiftly identifying and resolving any potential issues to uphold seamless data processing operations and minimize downtime. Drive comprehensive documentation of data pipelines, workflows, and procedures to foster knowledge sharing and ensure ongoing system maintainability and scalability. Skills required: Hands-on advanced experience in designing, developing, and managing data pipelines using Azure Data Factory. Strong working knowledge of Databricks for data processing, analytics and Machine learning. Advanced experience with data modelling techniques and data warehousing concepts. Advanced proficiency in SQL for data querying and manipulation and good knowledge of Python. Ability to work effectively in a fast-paced, dynamic environment and manage multiple priorities, following the Agile way of working Ability to lead and analyse complex data problems and propose effective solutions. Excellent communication skills with the ability to collaborate effectively with cross-functional teams. This represents an excellent opportunity for a Data Engineer with strong hands on experience within the Azure stack, who also has some leadership/mentorship experience. There is plenty of progression available for the right person. If you are interested, please apply for full details.