Data Engineer

Airtime Rewards Limited ,
Manchester, Greater Manchester
More Details

Overview

Job Description

We are looking for an experienced Data Engineer to join our team. This is the first hire in this newly formed Data Engineering team and you will have the opportunity to help shape this function working with the management team. We are looking for someone to build scalable, reliable and secure cloud data warehouse solutions and data integration and processing pipelines and you will need to have experience with a range of technologies to do this. Data Analytics forms a key part of our strategy this year. Ideally you will be familiar with AWS and you will use various methods and services available to transform raw data into a single customer view. Overall, youll strive for efficiency by aligning data systems with business goals. We are at the early stages of our journey and, as a Data Engineer, you will have a lot of opportunity to influence the technical and strategic direction of the team. You will also have the opportunity to take ownership of parts of the existing platform and new greenfield development. This is a position that would suit someone who has got some experience industry and exposure to a number of technologies in the field but is now looking to kick their career into the next phase. To succeed in this Data Engineering position, you should have strong analytical skills and the ability to combine data from different sources. If you are detail-oriented, with excellent organizational skills and experience in this field, wed like to hear from you. Responsibilities * Develop, maintain and improve our cloud data platform and help plan, design, monitor, communicate and execute data projects * Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using a range of technologies and environments (SQL, ETL tools, Kafka, Spark, Scala, AWS) * Prepare data for prescriptive and predictive modeling * Build algorithms and prototypes * Explore ways to enhance data quality and reliability * Identify opportunities for data acquisition * Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. * Work with business and technical stakeholders to assist with data-related technical issues and support their data infrastructure needs * Ensure data is reliably stored and secured * Create data tools for analytics and data scientist team members that assist them in building and optimizing our data product * Look for opportunities to tactically build solutions that deliver real value, while balancing the opportunities to implement longer term strategic solutions * Strong liaisons with the internal Tech teams Requirements * Demonstrable experience of working with and designing a cloud-based analytical platform including best practices around data ingestion (batch and streaming ETL/ELT) and turning data science/machine learning algorithms into production-grade products * Solid knowledge of data modelling and structures, and experience with data laking and warehousing tools and techniques (BigQuery, Spanner, Snowflake, Redshift etc.) * Strong software development skills (particularly in Python) object oriented and/or functional design, coding, and testing patterns, the relevant DevOps principles, and the ability to document in a clean manner * Experienced software engineer and keen to pursue the challenges of extracting knowledge from data and driven to understand the insights that data can bring * Technical expertise with data models, data mining, and segmentation techniques * Solid knowledge of data modelling and structures, and experience with data laking and warehousing tools and techniques (BigQuery, Spanner, Snowflake, Redshift etc.) * Solid hands-on experience with SQL, ETL/ELT tooling, Kafka, Spark, Python, Scala, ELK * Great numerical and analytical skills * Great communication and relationship development skills * The passion, drive and commitment to succeed in a fast-moving, highly pressured environment * Pro-active, self-starter attitude * Works with minimal supervision * Exposure to retail and online/digital commerce use-cases is a plus * Data Engineering certification (e.g IBM Certified Data Engineer) is a plus Benefits * City centre location * Brand new office fit out * Team lunch and drinks on Fridays * 23 days annual leave, plus one for each year served (capped at 26) * Birthday leave * Flexible start hours 06:30 - 10:30am * Health and wellbeing support * Training and conference budget * Share options take ownership of your role and our direction

People also viewed