Data Engineer (SQL / Azure)

Ascent Sourcing Ltd ,
Hereford, Herefordshire
Job Type: Full-time
Salary: £50,000 per annum

Overview

As Data Engineer some of your key duties will include: Designing, building, testing, and maintaining data pipelines to connect operational systems, data for analytics and BI systems. Delivering services that are automated, reliable and secure Ensuring that data is secured across different clients and in line with legislation Monitoring database and data pipeline performance and make recommendations when appropriate (query and data flow optimisation, index creation and maintenance) Liaising with all allpay departments and involvement in projects for future customer requirements and implementations. You’ll demonstrate experience in most of the following: Degree or qualification/experience obtained in the field of Computer Science, IT, engineering, Maths, Physics or equivalent. Microsoft Certified Azure Data Engineer Associate desirable. Experience in designing, building, and optimising data ingestion/ETL pipelines suitable for on-prem and Cloud-based architectures. Experience with Azure technologies: Data Factory v1 & v2, Databricks, Data Lake, Azure Synapse Analytics, Analysis Services, Stream Analytics, PolyBase, and u-SQLData warehousing, Kimball’s methodology, in particular. Detailed understanding structured database systems, including MS SQL Server (essential) and MySQL (desirable) Advanced knowledge of SQL queries, stored procedures and triggers. Ability to tune and optimise query performance, recommend indexes.