Azure Data Engineer

A skilled Azure Data Engineer with at least 3 years of relevant experience is needed to join our team at Now-Casting, a leading economic forecasting company based in London on a full-time, remote (work-from-home) basis. Candidates living in or near London will be given preference. You will take a key role in the ongoing modernisation and management of our data processing and reporting platform. The platform, which primarily runs on Microsoft Azure, is in the process of migrating and consolidating into Azure Databricks. This is an excellent opportunity to work with the latest and greatest Cloud and Data Engineering technologies and play a central role in a ‘Big Data’ business, which is increasingly involved in developing and supporting AI/ML models. About Us Now-Casting is a specialist econometric research and forecasting business, set up by world leading academics. The business is data-intensive, harnessing the latest econometric techniques – including machine learning models – to deliver a high value service to professional investors. Established more than 10 years ago, the business has a strong reputation in an international market. Although the company is based in London, its clients are in North America, Europe, Scandinavia and the Middle East. Key Responsibilities: Managing the company’s data assets, processes and infrastructure to ensure data integrity and optimal performance Designing and implementing data pipelines and workflows for data processing and reporting Collaborating with cross-functional teams to gather and analyse requirements Integrating the platform with third-party APIs Required Experience: Minimum of 3 years of relevant experience working as a Cloud and/or Data Engineer with a focus on Databricks, Azure (e.g. Azure Data Lake Storage), Apache Spark (PySpark), Python, and SQL Desirable Skills: TDD (e.g. PyTest) CI/CD (e.g. Azure DevOps or GitLab) MLFlow Unity Catalog MLOps Docker Sounds interesting? Click the APPLY button to send your CV for immediate consideration. Candidates with previous experience or job titles including; Cloud Data Engineering Specialist, Azure Data Platform Engineer, Cloud Data Architect, Azure Data Solutions Engineer, Azure Data Integration Engineer, Cloud Data Pipeline Engineer, Azure Data Warehouse Engineer, Cloud Data Infrastructure Specialist, and Azure Data Analytics Engineer will also be considered