Data Solutions Engineer

We have the ambition to deliver accurate insights to our large variety of users and use-cases in real-time. We want to be able to do (complex) event processing and support machine learning models real-time by building a streaming capability into our public cloud big data platform. For this, we are looking for a streaming platform engineer

Task

Designed and build streaming capability in our Integrated Data Store (Data Transformation Platform) on Azure.

Skillset

• Experience and understand data and machine learning engineering

• Experience in software engineering best practices and technologies (incl. reviewing, testing, CICD)

• Experience in designing, architecting and building cloud-based streaming capabilities

• Building on top of our existing big data platforms and frameworks

• Working together in a micro-team with a mix of engineers

• Experience in big-data systems

• Bring architecture and industry best practices

• Extensive experience in Python

• Adopt the inner source way of working

• Public cloud (Azure) experience, including the Azure native data engineering components

Techset

Azure
Kafka
Sparks streaming
Apache flink
Python
Stream analytics