Lead AWS Data Platform Engineer - Outside IR35

Posted 13 July 2022
Salary £550 - £650 per day + Outside IR35
LocationLondon
Job type Contract
ReferenceBBBH135517_1657725633
Contact NameTom Hilkene

Job description

My client are currently looking for an experienced Data Platform engineer to help build, design and solutionise a new AWS platform for the business.

This will be a critical role responsible for the design, development and operation of their data platform, from data ingestion, through data storage and processing, to the provision of data to downstream business processes.


Primary responsibilities include:

  • Defining and documenting the data platform architecture - technologies, tools, and processes.
  • Defining, delivering, operating and optimising the data platform infrastructure in the cloud (AWS).
  • Instantiating the ingestion of data from internal and external sources in structured and unstructured forms to populate the data platform stores. Developing the required APIs and interfaces, including Extract, Transform and Load (ETL) requirements.
  • Structuring and curating data in data stores including sql, no-sql and data lake repositories, including responsibility for the data model (Logical and Physical).
  • Providing data to downstream activities - Reporting, MI, Machine Learning, and data as a platform. Working with the users - including data scientists - to understanding their needs and collaboratively shaping solutions.
  • Performing tasks such as writing scripts, extracting data using APIs, writing SQL queries, etc.
  • Running the data platform; ensuring availability, performance, resilience, and continuity of data delivery services.
  • Ensuring robust data governance - a key member in data governance processes with prime responsibility for ensuring data quality (timely, accurate and complete).

Core tech:

  • Required technologies - SQL, Mongo DB, AWS Pipelines, Python, AWS Cloud, MS PowerBI.
  • Highly experienced in data engineering - successfully developing and driving data collection / management best practices.
  • Experience operating a data platform hosted in public cloud (AWS).
  • Continuous improvement experience, mindset and approach.

This is an immediate vacancy to interview and start asap