Data Engineer
Details
- Status:
- Gearchiveerd
- Publicatiedatum:
- 4-1-2021
- Weergaven:
- 99
- Reacties:
- 2
- Op locatie:
- Amsterdam
- FTE:
- 40 uur per week
Opdrachtomschrijving
As a IT Development Engineer (III) in the Voyager team, you and your team are responsible for the RAP platform, a data lake used for (Credit Risk) Data Modelling purposes. The team is working fully Agile DevOps and has end to end responsibility.
Your job
• You work closely with modellers and data engineers to understand the data they need
Coach and support the less experienced team members in design and building data solutions in a future proof way and writing the code to implement it
Engage in maintaining the solutions, resolve bugs and make sure the solutions run according to the expectations of our stakeholders
Develop ETL/ELT pipelines for processing and handling large amount of data and monitor the performance of the pipeline and other cloud services.
Develop BI data models and create BI reports.
Discuss requirements with stakeholders and prioritize them accordingly with the team.
The person should have a very good and deep understanding of data processes, data modelling, data pipelines (ETL), data lifecycle etc. The replacement should also have a good understanding of Big Data systems as well as BI. Technology wise:Python, ADLS, ADF, Databricks, PowerBI, CI/CD, Azure DevOps. Complimenting this with a bit of business understanding is an added value, because it enables to challenge the stakeholders and drive a constructive discussion regarding the requirements.
Working environment
The RD&M Grid is part of Risk Management. The Risk Management organization is a dynamic environment where we work in an Agile way to be able to have focus and being result-oriented in light of the (technological and regulatory) developments and work together with our internal customers.
•Working in an multi-disciplinary Scrum team of around +/- 9 people
•Informal environment with a lot of room for fun
•Young and dynamic department
•Diverse and international environment (e.g. at least 8 different nationalities are represented currently)
Your profile
You are familiar with cloud concepts (preferably Azure)
You have hands-on experience with building data solutions with Azure native data tooling (i.e. Data Factory, Data Bricks) and other data related technologies (i.e. Spark)
You have a deep understanding of data processes, data modelling, data pipelines (ETL), and data lifecycle.
You are familiar with Python
You have a good understanding of Big Data systems as well as BI.
Technology wise, you have experience in Python, ADLS, ADF, Databricks, and PowerBI, and CI/CD.
You have experience with coaching your less experienced team members in their design and development activities
You have knowledge of and are interested in the latest IT-trends, both within and outside your area of expertise (cloud, API, Open Banking, DevOps, CI/CD, SOA, etc.)
You have worked in the financial sector At a glance