Data Engineer
Details
- Status:
- Gearchiveerd
- Publicatiedatum:
- 24-12-2020
- Weergaven:
- 101
- Reacties:
- 7
- Op locatie:
- Amsterdam
- FTE:
- 40 uur per week
Opdrachtomschrijving
For one of our clients in banking we are looking for multiple Data Engineers, from medior to senior level of experience.
This role is open for freelance professionals, as well as for third party contractors.
As a Data Engineer in the Voyager team, you and your team are responsible for the RAP platform, a data lake used for (Credit Risk) Data Modelling purposes. The team is working fully Agile DevOps and has end to end responsibility.
You work closely with modellers and data engineers to understand the data they need
Coach and support the less experienced team members in design and building data solutions in a future proof way and writing the code to implement it
Engage in maintaining the solutions, resolve bugs and make sure the solutions run according to the expectations of our stakeholders
Develop ETL/ELT pipelines for processing and handling large amount of data and monitor the performance of the pipeline and other cloud services.
Develop BI data models and create BI reports.
Discuss requirements with stakeholders and prioritize them accordingly with the team.
With the following results
The person should have a very good and deep understanding of data processes, data modelling, data pipelines (ETL), data lifecycle etc. The person should also have a good understanding of Big Data systems as well as BI. Technology wise:Python, ADLS, ADF, Databricks, PowerBI, CI/CD, Azure DevOps. Complimenting this with a bit of business understanding is an added value, because it enables to challenge the stakeholders and drive a constructive discussion regarding the requirements.
Working environment
The RD&M Grid is part of Risk Management. The Risk Management organization is a dynamic environment where we work in an Agile way to be able to have focus and being result-oriented in light of the (technological and regulatory) developments and work together with our internal customers.
Working in an multi-disciplinary Scrum team of around +/- 9 people
Informal environment with a lot of room for fun
Young and dynamic department
Diverse and international environment (e.g. at least 8 different nationalities are represented currently)
The success of our organisation depends on the quality of our people and the ideas that they have. Truly surprising insights and innovative solutions for our clients result from an interplay of cultures, knowledge and experience. Diversity is therefore extremely important to our organisation. To ensure that everyone at the bank can develop their talents, we encourage an inclusive culture in which all colleagues feel engaged and appreciated.
Your profile
You are familiar with cloud concepts (preferably Azure)
You have hands-on experience with building data solutions with Azure native data tooling (i.e. Data Factory, Data Bricks) and other data related technologies (i.e. Spark)
You have a deep understanding of data processes, data modelling, data pipelines (ETL), and data lifecycle.
You are familiar with Python
You have a good understanding of Big Data systems as well as BI.
Technology wise, you have experience in Python, ADLS, ADF, Databricks, and PowerBI, and CI/CD.
You have experience with coaching your less experienced team members in their design and development activities (for the senior data engineer)
You have knowledge of and are interested in the latest IT-trends, both within and outside your area of expertise (cloud, API, Open Banking, DevOps, CI/CD, SOA, etc.)
You have experience with Azure cloud, ci/cd and the DevOps way of working
You have worked in the financial sector (must-have)