Big Data Engineer

Harvey Nash ,
Glasgow, City of Glasgow
Contract Type: Permanent
Salary: £50000 - £60000 per annum + Benefits package

Overview

We have a new role within one of the UK's largest private companys, which is also a Scottish success story. With a turner over of over £1 billion, they offer secure employment in the Glasgow HQ. This role will be working with high velocity data from some of the world's largest retailers, supporting ground-breaking BI and Artificial Intelligence use cases ,in a key growth area for company. Your responsibilities will include: Design and implement pipelines to ingest data into and consume data from the data lake Source and transform data from historical and streaming data sources Implement automated monitoring and alerting on pipelines to ensure consistent processing of data Design systems to allow real time analytics on high velocity data Proactively ensure optimum performance by revisiting design choices to check they are still fit for purpose Collaborate with Data Scientists and BI Developers to ensure the wider team's objectives are being met by data lake design Support wider team in consuming data from the data lake We are keen to speak to Big Data Engineers with the following track record: Commercial experience of a Big Data Tech Stack Exposure to Azure HDFS Databricks Data Lakes You will provide solutions for big data projects, be independant and have a proactive attitude. This is a permanent opportunity in Glasgow. You will have free onsite parking, pension, subsidised canteen and much more. Please send CV on first instance.