Data Engineer
Details
- Status:
- Gearchiveerd
- Publicatiedatum:
- 10-11-2020
- Weergaven:
- 92
- Reacties:
- 1
- Op locatie:
- Amsterdam
- FTE:
- 40 uur per week
Opdrachtomschrijving
We are looking for a savvy Data Engineer to join a growing team of analytics experts. You will be responsible for expanding and optimizing the data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
Responsibilities
Create and maintain optimal data pipeline architecture.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics.
Keep the data secure & protected.
Qualifications
3+ years’ experience working with data in an Azure environment.
Experienced in Python is a must
Experience working with one or more of these: Apache Spark or Apache Airflow.
Solid understanding of various Data Management tools available in Azure.
Azure services relevant to scalable pipelines.
- Location
Amsterdam
- Duration
6 months