Product Features
Blog
Contact Us
Sign In
Sparta Global
,
London, Greater London
Senior Data Engineer
|
|
Job Type: Full-time |
|---|---|
|
|
Salary: £60,000 per annum |
Overview
Sparta Global is looking to recruit a Senior Data Engineer to work with our client, Global Manufacturer of Food Products. This is a permanent position based in London. Your primary responsibilities will be to coach and mentor a team of Junior Engineers as well as being a technical lead. We will offer a salary of up to £80k benefits ( Holidays, pension, support and ongoing training) Your role: You will mentor, coach and inspire a team of enthusiastic, aspiring data engineers You will share ideas, promote best practices and suggest enhancements to our platform You will lead engineering projects on our data platform, helping build the foundations You will manage data from across divisions to produce valuable data assets You will take full ownership for specific areas of development within the Kinship data platform You will help engineer and orchestrate data models & pipelines in a cloud environment using a progressive tech stack g. Databricks, Spark, Python, PySpark, Delta Lake, SQL, Logic Apps, Azure Functions, ADLS, Parquet, Neo4J, Flask You will actively research and suggest new technologies, promoting evolution of our platform You will enthusiastically evolve your skillset, learning new technologies and techniques You will promote DevOps & CI/CD methodologies to collaborate within an agile environment You will work closely with analysts, data scientists and technology partners to understand their requirements You will exercise fluid communication with the Data Engineering Lead, working with them closely and bouncing off ideas Required Skills: Experience leading a team in either a technical or line manager function Capacity and enthusiasm for mentoring and coaching less experienced engineers Able to partner effectively with business stakeholders in order to deliver Expert knowledge in at least one of: Python (or similar), SQL, PySpark Experience working in a Microsoft Azure or similar cloud environment Experienced in designing/building/leading on end to end data pipeline/ETL/ELT solutions Ability and strong desire to research and learn new technologies and languages Expert knowledge of the contemporary data engineering and analytics landscape, the current tools, the pertinent approaches and the likely challenges Advocate of CI/CD methodologies and agile working Knowledge/experience processing data using Spark / Databricks / Azure Data Factory or similar Desired Skills: Microsoft Azure cloud technologies e.g. Blob Storage, ADLS, Azure DevOps, Azure Logic Apps, Azure Functions Graph database technologies (e.g. Neo4J / Cypher) Delta Lake storage layer Data visualisation tools e.g. PowerBI, Tableau, Thoughtspot, D3.js