Product Features
Blog
Contact Us
Sign In
Harnham
,
London, Greater London
Senior Data Engineer
|
|
Job Type: Full-time |
|---|---|
|
|
Salary: £70,000 per annum |
Overview
SENIOR DATA ENGINEER (PYTHON, SPARK, AWS) LONDON BETWEEN £70,000 - £85,000 This vacancy is an excellent opportunity to join a highly complex data environment. The current Data Engineering team are processing petabyte scale data from a variety of internal and external sources. The current tech stack in production involves Python, Spark, AWS (Lambda, S3, Kinesis, Terraform) and Kafka. The client is a leading retailer. COMPANY: The company has a number of squads associated to the various product streams that generate profit. Whilst each separate product stream operates with a certain degree of autonomy, they have an enterprise wide data lake upon which you will be working. For example they operate high street retail stores in addition to holding a credible banking presence. The scale of data at the companies disposal make it a fascinating data engineering environment to be working in. ROLE: Data lake population (S3) Data pipelines creation using PySpark Streaming projects utilising Kinesis & Kafka Influencing best coding practices such as Test Driven Development SKILLS & EXPERIENCES: Background in software programming in Python (preferably) Commercial exposure to PySpark and AWS Strong communication skills to interact with the wider team Adherence to best coding practices (Unit testing etc) HOW TO APPLY: Please register your interest by sending you CV to William Wrigley via the apply link on this page