Senior Data Engineer

Opus Recruitment Solutions Ltd ,
London, Greater London
Salary: £85000 - £95000 per annum

Overview

Want to work for AI Fintech Company in the UK? They are looking for passionate Senior Data Engineers who can hit the ground running. You will be working on exciting and challenging new projects where you can make a massive difference and improving their financial AI platforms. They are a massive tech house, where you will be working ongoing Greenfield projects and have the amazing opportunity to work with the latest technology. What you will be doing: Liaise with data scientists, data analysts and decision-makers such as product owners and business analysts to gather and analyse the data requirements Design and implement data pipelines to ingest the data into both data warehouse and data lake from a variety of data sources having complex data structures Work with CloudFormation templates to maintain the analytics infrastructure Data Modeling to ensure the data integrity, ease of data access and for better query performance Key Skills: 4 years demonstrable experience in data engineering or related domain Strong understanding of Python data structures and algorithms Experience building custom data pipelines (ETL/ELT) using Python and PySpark Experience working with Postgres and Redshift databases Proficient in writing complex SQL statements • Experience working with CI/CD Experience with different AWS services like S3, Lambda, Glue, Redshift, Kinesis, etc., Understanding of software development life cycle and practices such as coding standards, code reviews and version control using Git Excellent analytical, problem-solving and communication skills Bonus points for: Terraform or AWS CloudFormation If you are interested in this role, apply with an up to date CV or simply give me a call on 02074487204 (Jayden) and ill be in touch with you This job was originally posted as www.totaljobs.com/job/89691793