We are looking for a senior Big Data Engineer who will work on a new big data platform to Amazon. The main objective will be to create a secure, stable and cost affective environment. Main tasks will be monitoring data, recoveries and ETL tasks.
The client uses a centralized content repository to store its (humongous amounts of) data/content and make it available for users and new products. The platform uses natural language processing, image recognition and search technology to make the content accessible and (re)usable for several purposes within the company.
MSc. in Computer Sciences;
Knowledge of ETL, ETL workflows and common ETL packages;
Experienced in gathering and understanding business requirements from Data Scientists and the Customer Data Custodian;
Experienced in executing business requirements; aggregate, normalize data, build the single customer profile;
Experienced in data visualization;
Knowledge of Hadoop and Apache Hive;
Knowledge of Linux and preferably Amazone products like EC2, EMR, RDS, Kinesis and Red Shift;
Knowledge of Python, Java, R (one of these will be sufficient) and SQL.
Knowledge of Jenkins.
until the end of year with a possibility for extension
minimum of 32, maximum 40.
preferable Dutch, English would also be ok
4 software engineers and 1 Scrum Master
Reactie is prive en alleen zichtbaar voor de opdrachtgever en de plaatser van de reactie.
Je moet inloggen voordat je een reactie kunt plaatsen.