Cloud Dataops Engineer
Details
- Status:
- Gearchiveerd
- Publicatiedatum:
- 20-5-2019
- Weergaven:
- 51
- Op locatie:
- Rotterdam
- FTE:
- 40 uur per week
Opdrachtomschrijving
Templeton & Partners are currently looking for an experienced Cloud Dataops Engineer to join a dynamic team for one of the Largest World leading Energy Company on the Globe.
Please read through the description below to see if you might be suitible for this role.
We are more than delighted to answer any questions or walk you through this specific role at any time.
Cloud Native Engineering DataOps Engineer:
Do you want to work on a team building Clients next generation software engineering & AI platform? Do you want to work with the latest opensource toolset? Join our newly formed Cloud Native Engineering team as DataOps Engineer and help shape the future of data science.
As a DataOps Engineer you will work as part of a team of global DataOps Engineers who partner with data science teams throughout the organization with the goal of improving products, features, and flow reliability.
Our Data Science Tech stack: Azure & AWS, Terraform, Jenkins, Docker, EKS (Kubernetes), KubeFlow, ML Flow, Pachyderm, Jupyter Note books and much more
Mission Specs
Design solutions to deeply optimize the big data computing and storage setup, to enable new business needs
Design and build the infrastructure for data extraction, preparation, and loading of data from a variety of sources
Implement tools and processes to automate the management of our infrastructure
Provide guidance to improve resilience and scalability of our Data Platform
Implement and optimize platform configurations for cost, security, and performance
Implement monitoring and alerting solutions to provide insight into overall Data Platform health
Craft and maintain documentation of infrastructure and processes,
Must Haves
Grit, drive and a deep feeling of ownership
BS/MS with quantitative focus (e.g. Computer Science, Economics, Mathematics, Physics, Statistics) or equivalent practical experience,
Deep knowledge of AWS infrastructure and automation with experience setting-up, managing, and maintaining large-scale infrastructure and platforms (EC2, RDS, S3, VPC, etc.),
Experience of automation and provisioning approaches, using tools such as Terraform, Bash, PowerShell, etc,
Familiar with operations of third-party Big Data Platform and Infrastructure-as-a-Service (PaaS/IaaS) technologies (i.e. , Databricks),
Experience of agile project management approaches and tools (eg Atlassian Jira/Confluence),
Experience in setting up server-less and data streaming technologies (lambda, Kinesis, Kafka, DataBricks, Spark),
Experience in setting ETL / data pipeline solutions
Fundamental knowledge of security best practices in cloud
Ability to quickly learn, understand and work with new and emerging technologies, methodologies, and solutions in the cloud and IT technology space,
Strong communication and interpersonal skills with attention to detail, highly agile and self-starter.
About Cloud Native Engineering
The Cloud Native Engineering Practice is an organization of SRE engineers who work with our production services throughout their entire life cycle, from design and architecture, through implementation, deployment, and sustaining operation. Our SRE team delivers important system properties: reliability, performance, efficiency, and scalability, for the products and platforms that our customers use every day. SRE’s work in high-performance squads with expertise on large scale system reliability and in-depth understanding of critical business components architecture, as well as dedicated engineering teams building comprehensive tools, platform and infrastructure.
We need your skills and passion to help make it happen, So Please let us know if you are suitable towards this role !