Big Data Java Engineer

Job Title: Java Big Data Engineer Location: London Salary: up to £100K depending on experience. Austin Fraser is supporting an innovative and international software company in London who are looking to on board an experienced Java Big Data Engineer on a permanent basis. You will be joining an established development team and working on their flagship product which is a data platform involving ML techniques. In this role, you will be responsible for designing, developing, and optimizing data pipelines, processing large-scale datasets, and ensuring efficient integration of data with various big data platforms. Your expertise in Java and big data technologies will help with the use of data for critical business insights. Minimum 5+ years of experience in software engineering with strong expertise in Java and related frameworks. Proven experience with big data technologies such as Apache Hadoop, Apache Spark, Apache Kafka, or other distributed systems. Experience building data pipelines for processing large datasets in batch and real-time. Familiarity with cloud platforms like AWS, Google Cloud, or Azure is a plus. Experience with data storage systems and relational databases. Experience with data processing frameworks.