Lead Data Engineer - London - £90k
Investigo have engaged with a long-standing client in their search for a Lead Data Engineer. The role is on a permanent basis and will be supporting a mature Data Science function with the infrastructure and pipelines required to handle massive amounts of data.
We are looking for candidates that are comfortable developing data pipelines and processing infrastructure from the ground up and that are able to interface openly with the Data Science team. An understanding of data science principles and methodologies would therefore be advantageous but is not required.
Candidates must also demonstrate understanding of DevOps concepts, including CI/CD, build automation and any infrastructure automation knowledge is desirable.
You will also be working in cross-functional teams, so you should be comfortable with agile methodologies and understand the value of their use. Experience with Scrum and Kanban would be useful, and a good understanding of SDLC is crucial.
Technologies:
- Python, Scala
- Microsoft Azure (Azure Data Factory)
- Apache Spark / PySpark
- Azure DevOps, Ansible, Jenkins
- Docker, Kubernetes
If this role sounds of interest, please apply within to be considered.
