Lead Data Engineer

Posted 16 October 2020
Salary Up to £90000.00 per annum
LocationLondon
Job type Permanent
ReferenceBBBH108419_1602840466

Job description


Lead Data Engineer - London - £90k

Investigo have engaged with a long-standing client in their search for a Lead Data Engineer. The role is on a permanent basis and will be supporting a mature Data Science function with the infrastructure and pipelines required to handle massive amounts of data.


We are looking for candidates that are comfortable developing data pipelines and processing infrastructure from the ground up and that are able to interface openly with the Data Science team. An understanding of data science principles and methodologies would therefore be advantageous but is not required.


Candidates must also demonstrate understanding of DevOps concepts, including CI/CD, build automation and any infrastructure automation knowledge is desirable.


You will also be working in cross-functional teams, so you should be comfortable with agile methodologies and understand the value of their use. Experience with Scrum and Kanban would be useful, and a good understanding of SDLC is crucial.

Technologies:
- Python, Scala
- Microsoft Azure (Azure Data Factory)
- Apache Spark / PySpark
- Azure DevOps, Ansible, Jenkins
- Docker, Kubernetes

If this role sounds of interest, please apply within to be considered.