Big Data System Engineer
Details
- Status:
- Gearchiveerd
- Publicatiedatum:
- 4-5-2020
- Weergaven:
- 65
- Reacties:
- 3
- FTE:
- 40 uur per week
Opdrachtomschrijving
We are currently looking for an experienced Big Data Engineer for one of the leaders in the transport industry based in Belgium.
Project Overview:
The Big Data System Engineer is included in a team of system administrators responsible for the Big Data infrastructure of our client, which includes:
Managing and monitoring the software and hardware in the Big Data landscape
Installing, configuring, testing and maintaining operating systems (Red Hat) and Big Data middleware
Performance management of the installed systems and applications
Management of security, backup and HA strategies
Providing 2nd and 3rd line support
Contacts with vendors and developers for systems management and troubleshooting
What our client is looking for:
At least 5 years of relevant experience as a Big Data Administrator /Engineer
Elastic as a search engine (Elastic, logstash, beats, Kibana)
The Hadoop ecosystem (Cloudera, HDFS, Yarn, Spark, Hive, Druid)
Thorough experience with ETL Tools, Workflow management Nifi, Airflow, Streaming Kafka
Machine Learning (Spark ML, H2O, scikit-learn, Keras, TensorFlow)
Big Data Security Frameworks
Cloud experience (preferably with Azure)
Virtualization and containerization (e.g., Virtual Box, OpenShift)
Experience with monitoring systems
Automation software (e.g., Puppet, Chef)
Good scripting skills (e.g., Shell scripts, Perl, Ruby, Python)
Thorough network knowledge (OSI network layers, TCP / IP)
Motivated team player who is customer-oriented and has focused on delivering quality
Does this sound like the next challenge in your career?
If yes then we are looking forward to receive your application and will be in touch promptly to discuss this opportunity in more detail over the phone.