Product Features
Blog
Contact Us
Sign In
McGregor Boyall
,
Nottingham, Nottinghamshire
Data Engineer
|
|
Job Type: Full-time |
|---|---|
|
|
Salary: £50,000 per annum |
Overview
Data Engineer Data, Engineering, Python, Scala, Java, Spark, Hadoop, HBase, Impala, HDFS, Kafka, Storm, Cloud, AWS, Azure, SQL, ELK stack, Data pipelines My client, a large consultancy, are looking for Data Engineers to work internally on their Data Analytics platform in Nottingham. They require skilled data engineers who are well versed in building data pipelines and utilising Big Data technologies. They also need people with cloud experience and good programming skills in Python and Java. Key skills and experience required (they are looking for candidates to have the majority of the below skills): Python and Java ideally (Scala is also welcomed) Hands-on Spark experience (both batch and stream processing) Hadoop ecosystem exposure (YARN, HDFS, HBase, custom MapReduce jobs, Hive/Impala) Hands-on experience with at least one distributed NoSQL storage (HBase, Cassandra) Understanding of cluster resource management tools (YARN, Mesos) Stream processing tools like Kafka, Storm Cloud architecture (ie AWS Kinesis, Data Pipeline, EMR, Glue, Redshift, Athena) General SQL skills Experience with ELK stack (desirable) Please respond with an up to date CV for further information - McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.