Data Engineer

Details

Status:
Gearchiveerd
Publicatiedatum:
30-12-2019
Weergaven:
80
Reacties:
2
Op locatie:
Amsterdam
FTE:
40 uur per week

Opdrachtomschrijving

We are looking for a Data Engineer who enjoys solving problems and is willing to help improve our products. You are passionate about data and willing to work with the business to understand requirements and provide high-quality data and data products. Your responsibility includes creating, testing, optimizing and monitoring ETL pipelines and collaborating with the rest of the data engineering team to improve the data platform and standards for the organization. You'll have the opportunity to help data scientists deploy and scale their models as well as collaborate with them on their solutions and improving their quality of code.

The project that you will be working on has been developed for the label Tempo Team but has to be upscaled to the other labels. The project emphasis on a tool that scrapes vacancies online and registers which company posted the vacancies, it’s location, the job title etc. All this information will be registered in a database and an automated system will send out a notification to a sales consultant. This will give the sales consultant a lead and head start to contact the company and fill in the open position. You will be responsible for this Proof of Concept and roll out of this existing smart email marketing campaign. Another important role will be the guidance of a junior data engineer.

Need to have

  • software and/or data engineering experience

  • Good understanding of basic analytics

  • Agile way of working

  • The ability to communicate in technology and business settings

  • Knowledge of cloud solutions

  • DevOps experience - CI/CD

  • Data structures and formats

  • Experience with (automated) testing

  • Strong troubleshooting and debugging skills, with a passion for problem solving and investigation

  • Scripting languages

  • Knowledge of programming concepts

Tool experience includes

  • analysis tools like Python / Pandas (at least 3 years)

  • linux, bash scripting and Git

  • relational databases

Nice to have

  • AWS (Cloud Formation, S3, Redshift, Sagemaker. EMR)

  • A/B testing

  • Understanding of machine learning concepts

  • Other cloud platforms

  • Code Optimization

  • Jenkins

  • Spark

  • Docker

  • Airflow

Skills and competencies the candidate will need are

  • Ability and willingness to learn new technologies

  • Ability to understand business requirements and create technical design

  • Ability to work in a team

  • Fluent in English, both orally and in writing

Note: this position is only open for freelance/ZZP

Verder kijken

Vergelijkbare open opdrachten