Azure Data Platform Engineer
Details
- Status:
- Gearchiveerd
- Publicatiedatum:
- 2-6-2020
- Weergaven:
- 73
- Reacties:
- 4
- Op locatie:
- Amsterdam
- FTE:
- 36 uur per week
Opdrachtomschrijving
Azure Data Platform Engineer
The department provides users with tools, technologies, and methodologies needed for automated, data-driven decision making. They support many data engineering teams (who build data pipelines/ETL) across the bank, by leveraging Azure services, and building frameworks and tools on top of it that will be provided as a shared service. They do this from a single Data Platform Team, consisting of data platform consultants, platform engineers, and reliability engineers. My client is looking for a Data Platform Engineer to help further build their tools and frameworks.
Delivery of new tools and frameworks such as;
*Data Orchestration
*Access & security framework
*Ingestion and exploration framework
*ETL framework
*CI/CD
*Monitoring & logging
Must have
*Experience in building big data systems incl. standardized methodologies, frameworks, patterns and blueprints (>4 years)
*Public cloud (Azure) experience (>2 years), including the Azure native data engineering components such as DataBricks
*>6 years experience in software engineering best practices and technologies (incl. reviewing, testing, CICD)
*Experience in designing, architecting and building cloud-based frameworks (access management, ingestion framework, ETL framework, monitoring framework, etc.)
*Bring architecture and industry best practices on designing and implementing data lakes/data platforms
*Advanced in Python (object-oriented)
*Experience in source code management & Azure DevOps
Nice to have
*Working together in a micro-team structure with a mix of engineers
*Ability to proactive take ownership of issues/enhancements/features and helping to define a plan and related coordination activities to provide an end to end solution
*Contributions towards Open-source libraries
*Experience with Airflow
*Knowledge and mindset of InnerSource way of working and reviewing code
*Azure Certifications