Product Features
Blog
Contact Us
Sign In
Harnham
,
London, Greater London
Big Data Engineer PySpark
|
|
Job Type: Full-time |
|---|---|
|
|
Salary: £60,000 per annum |
Overview
THE COMPANY This leading retailer has one of if not the strongest Data Engineering team in the UK. They are currently looking for a Data Engineer who specialises in Pyspark to join one of their agile squads and help build and ingest data into their S3 Data Lake. THE ROLE On a daily basis you will be: Utilise the appropriate development, data engineering (ETL & ELT, stream processing), test and release model(s) and be flexible with your approach Apply the appropriate standards and principles when delivering data ingestion and data transformation into target data models Convert algorithms, models and features created by data scientists, analysts and designers from prototypes/designs into production solutions Deliver, cost effective, appropriate capabilities for the business. Create Data Lakes & Data Pipelines SKILLS AND EXPERIENCE Strong Python/Spark (Pyspark) experience An engineer with a passion for delivering solutions to customers Someone who likes to roll up their sleeves and enjoys learning An understanding of data modelling, access an storage Self-driven and constantly striving to improve your skills Advocate of agile/lean delivery methodologies THE BENEFITS Competitive pension scheme Up to 90k Salary HOW TO APPLY Please register your interest by sending your CV to Daniel Moss via the Apply link on this page