Big Data Engineer

Harvey Nash ,
Glasgow, City of Glasgow
More Details
Salary: £50000 - £60000 per annum

Overview

Harvey Nash's client are on the lookout for a Big Data Engineer to join their team on a permanent basis to design, implement and optimise processes to ingest data from a variety of sources including IoT devices using big data technologies. Identify and implement optimum data lake storage format and retrieval methods and technologies and to provide data and support to a wider team of Data Scientists & BI Developers. PRINCIPAL TASKS AND RESPONSIBILITIES: Design and implement pipelines to ingest data into and consume data from the data lake Source and transform data from historical and streaming data sources Implement automated monitoring and alerting on pipelines to ensure consistent processing of data Design systems to allow real time analytics on high velocity data Proactively ensure optimum performance by revisiting design choices to check they are still fit for purpose Collaborate with Data Scientists and BI Developers to ensure the wider team's objectives are being met by data lake design Support wider team in consuming data from the data lake Be able to provide technical leadership in the use and design of big data technologies We are looking for you to have: Experience utilising technologies preferably in Azure platform Data pipeline design and optimisation Internet of Things SQL Server If this is of interest please send across your CV in the first instance or contact Cameron Gunn on 0141 343 3286 This job was originally posted as www.cwjobs.co.uk/job/89942216

People also viewed