Data Engineer

Details

Status:
Gearchiveerd
Publicatiedatum:
10-11-2020
Weergaven:
92
Reacties:
1
Op locatie:
Amsterdam
FTE:
40 uur per week

Opdrachtomschrijving

We are looking for a savvy Data Engineer to join a growing team of analytics experts. You will be responsible for expanding and optimizing the data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.

Responsibilities

  • Create and maintain optimal data pipeline architecture.

  • Assemble large, complex data sets that meet functional / non-functional business requirements.

  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.

  • Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics.

  • Keep the data secure & protected.

Qualifications

  • 3+ years’ experience working with data in an Azure environment.

  • Experienced in Python is a must

  • Experience working with one or more of these: Apache Spark or Apache Airflow.

  • Solid understanding of various Data Management tools available in Azure.

  • Azure services relevant to scalable pipelines.

Location

Amsterdam

Duration

6 months

if you are interested in this position please send your cv and your motivation letter

Verder kijken

Vergelijkbare open opdrachten