Senior Engineer, Data Engineering

Company:  Senitor Associates
Location: Chelmsford
Closing Date: 08/11/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description
Senior Data Engineer - Hybrid/Remote - Salary £55-65K ** This is an exceptional opportunity for a hands-on, talented data engineer who wants to lead the design and build out of a new data platform for reporting and analytics within a fast-growing Insurtech business. The successful applicant will be a skilled data professional that can lead on building out a new companywide data platform, reporting and analytics solutions. The successful applicant will have strong experience in data modeling, data engineering and visualization for business analytics and reporting. They will also have a proven track record of delivering data engineering and business intelligence solutions. Minimum 6+ years commercial experience in a data engineering role Have strong data modelling experience (star schema / Kimball), SQL and Python experience Have a proven track record in data modelling, building out data infrastructure and ETL pipelines Strong data visualisation experience in Power BI using DAX Be experienced using Azure data platform tools including Azure Data Lake, Azure Data Factory, Synapse / Fabric, Databricks, Spark and other data tools Knowledge of machine learning and advanced analytics within the Azure ecosystem (e.g. Azure ML). Familiarity with Data Governance practices in conjunction with Azure Purview (data lineage, data categorization, and data certification) Certification such as Microsoft Certified: Azure Data Engineer Associate or Microsoft Certified: Design data models and lakehouse’s using medallion architecture that integrate data from Azure Data Lake Storage Gen2, Azure SQL databases, and other sources for consumption in Power BI and Synapse SQL pools. Develop, maintain, and optimize semantic data models using Azure Synapse Analytics / Fabric, Spark notebooks. Ensure data model accuracy, scalability, and performance. Use PySpark within Azure notebooks to extract, transform, and load (ETL/ELT) data from raw formats (e.g. Implement data transformation pipelines and workflows in PySpark. Partner with DevOps teams to deploy and maintain data models in production environments. Optimizing data models from various sources such as Azure SQL databases and Azure Data Lake Storage Gen2 for usage in Power BI Ensure efficient querying of large datasets and troubleshoot any performance issues related to data retrieval or processing. Create and maintain detailed documentation and schematics of data models, metadata, and processes using suitable tools, such as Visio. Develop and enforce data governance and data modelling standards to ensure consistency and accuracy across all models. Ensure all data modelling practices adhere to security and compliance requirements, including role-based access control, encryption, and data privacy laws (e.g., Applying RL/CL/OL security within the data models as defined by business use and target audience
Apply Now
Share this job
Senitor Associates
  • Similar Jobs

  • Senior Engineer

    Broomfield
    View Job
  • Senior Firmware Engineer

    Chelmsford
    View Job
  • Senior Maintenance Engineer

    Essex
    View Job
  • Senior Firmware Engineer

    Chelmsford
    View Job
  • Engineering Technician

    Essex
    View Job
An error has occurred. This application may no longer respond until reloaded. Reload 🗙