Big Data Engineer

Big Data Engineer

An exciting long-term project for a market leading financial organisation, I’m looking for a Senior Big Data Engineer who is passionate about functional programming and IT Security. This is for a 24-36 months contract, located in Amsterdam.

•Are you experienced with distributed big data clusters?
•Does building a real time fraud detection platform and building highly secure and scalable API’s sound interesting to you?
•Do you know your way around data transformations, exploration and optimizing performance of queries of the notebooks of users of a big data platform?
•Do you love to support other people to grow?
•Are you are a motivated engineer who likes to work in a team on complex solutions?

-If you have answered yes, then please read on and get in touch if you are interested in applying.

Minimum of 1-2 years of experience in leading and coaching fellow engineers in a hierarchical or project role. Minimum of 5 years of experience as a DevOps engineer in similar environments.

Must haves on senior level (5+ years of experience)

•A team player mindset
•You love technology and naturally stay up to date on relevant new developments
•software engineering experience, preferably in creating high scalability mission-critical applications.
•You value a multi-cultured environment where English is the working language and you easily get on with people from different cultural backgrounds.

The following tools and frameworks are part of the landscape

•Containerized Big Data environment in DC/OS, Mesos.
•SPARK
•Notebooks (Zeppelin/Jupyter)
•S3 Object Storage
•CI/CD like Ansible, Git
•Linux, Bash Scripting
•Tools: Nifi, Kafka, Presto, Hive, Spark, Superset,

Please send in your latest CV to apply or feel free to contact me directly for more information.