Data Engineer
Details
- Status:
- Gearchiveerd
- Publicatiedatum:
- 30-12-2019
- Weergaven:
- 80
- Reacties:
- 2
- Op locatie:
- Amsterdam
- FTE:
- 40 uur per week
Opdrachtomschrijving
We are looking for a Data Engineer who enjoys solving problems and is willing to help improve our products. You are passionate about data and willing to work with the business to understand requirements and provide high-quality data and data products. Your responsibility includes creating, testing, optimizing and monitoring ETL pipelines and collaborating with the rest of the data engineering team to improve the data platform and standards for the organization. You'll have the opportunity to help data scientists deploy and scale their models as well as collaborate with them on their solutions and improving their quality of code.
The project that you will be working on has been developed for the label Tempo Team but has to be upscaled to the other labels. The project emphasis on a tool that scrapes vacancies online and registers which company posted the vacancies, it’s location, the job title etc. All this information will be registered in a database and an automated system will send out a notification to a sales consultant. This will give the sales consultant a lead and head start to contact the company and fill in the open position. You will be responsible for this Proof of Concept and roll out of this existing smart email marketing campaign. Another important role will be the guidance of a junior data engineer.
Need to have
software and/or data engineering experience
Good understanding of basic analytics
Agile way of working
The ability to communicate in technology and business settings
Knowledge of cloud solutions
DevOps experience - CI/CD
Data structures and formats
Experience with (automated) testing
Strong troubleshooting and debugging skills, with a passion for problem solving and investigation
Scripting languages
Knowledge of programming concepts
Tool experience includes
analysis tools like Python / Pandas (at least 3 years)
linux, bash scripting and Git
relational databases
Nice to have
AWS (Cloud Formation, S3, Redshift, Sagemaker. EMR)
A/B testing
Understanding of machine learning concepts
Other cloud platforms
Code Optimization
Jenkins
Spark
Docker
Airflow
Skills and competencies the candidate will need are
Ability and willingness to learn new technologies
Ability to understand business requirements and create technical design
Ability to work in a team
Fluent in English, both orally and in writing
Note: this position is only open for freelance/ZZP