Data Engineer

Data Engineer - Hybrid/Remote - Salary £55-65K ** This is an exceptional opportunity for a hands-on, talented data engineer who wants to lead the design and build out of a new data platform for reporting and analytics within a fast-growing Insurtech business. Experience Minimum 6+ years commercial experience in a data engineering role Have strong data modelling experience (star schema / Kimball), SQL and Python experience Have a proven track record in data modelling, building out data infrastructure and ETL pipelines Strong data visualisation experience in Power BI using DAX Be experienced using Azure data platform tools including Azure Data Lake, Azure Data Factory, Synapse / Fabric, Databricks, Spark and other data tools Advantageous to have: Insurance domain knowledge a plus Knowledge of machine learning and advanced analytics within the Azure ecosystem (e.g. Azure ML). Familiarity with Data Governance practices in conjunction with Azure Purview (data lineage, data categorization, and data certification) Certification such as Microsoft Certified: Azure Data Engineer Associate or Microsoft Certified: Azure Solutions Architect Expert. Key Responsibilities: Design, build and maintain dimensional and relational models based on the business requirements. Design data models and lakehouse's using medallion architecture that integrate data from Azure Data Lake Storage Gen2, Azure SQL databases, and other sources for consumption in Power BI and Synapse SQL pools. Develop, maintain, and optimize semantic data models using Azure Synapse Analytics / Fabric, Spark notebooks. Ensure data model accuracy, scalability, and performance. Use PySpark within Azure notebooks to extract, transform, and load (ETL/ELT) data from raw formats (e.g. Delta, Parquet, CSV) stored in ADLS Gen2. Implement data transformation pipelines and workflows in PySpark. Partner with DevOps teams to deploy and maintain data models in production environments. Optimizing data models from various sources such as Azure SQL databases and Azure Data Lake Storage Gen2 for usage in Power BI Ensure efficient querying of large datasets and troubleshoot any performance issues related to data retrieval or processing. Create and maintain detailed documentation and schematics of data models, metadata, and processes using suitable tools, such as Visio. Develop and enforce data governance and data modelling standards to ensure consistency and accuracy across all models. Ensure all data modelling practices adhere to security and compliance requirements, including role-based access control, encryption, and data privacy laws (e.g., GDPR). Applying RL/CL/OL security within the data models as defined by business use and target audience For more information about Senitor and the opportunities we have to offer follow us on Twitter @SenitorIT Senitor Associates Ltd is acting as an Employment Agency in relation to this vacancy