Data Engineer

Data Engineer Permanent - Full time Location: Luton Salary: Negotiable Advantage Resourcing are currently recruiting for a Data Engineer to join a global e-commerce business in Luton. Job Purpose With a big investment into a Hadoop big data platform and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way our client stores, analyses and uses data in a fast paced organisation. You will join as a Data Engineer joining a team of committed data specialists. You will play a major role in adhering to big data best practices whilst building and maintaining reliable data pipelines and products across a range of exciting projects. Bringing a wealth of technical experience in data platforms combined with excellent skills in development. This role will support the business on the journey from a Greenfield big data estate to a mature data lead organisation. Job Accountabilities Support the business harness the power of data, supporting them with insight and analytics. Develop robust data pipelines/products to serve our clients analyst and data science communities. Work in a fast paced agile scrum environment with a "release within sprint mentality". Build best practice and constantly improve processes and core code bases. Work in partnership with Senior Data Engineers to conform to/define patterns and standards. Provide quality assurance to Data Engineering team's work through processes such as code reviews and TDD. Key Skills Required Familiarity in a UNIX environment and comfortable with shell-scripting, competent hands-on experience with database engines (e.g. SQL Server), Spark, Python, Hive, Impala. An accomplished ETL/ELT developer who has proven experience of delivering complex big data solutions - by either leveraging custom frameworks or off-the-shelf tools such as SSIS, Informatica, Talend. Worked with a combination of cloud based big data technologies Understanding of CICD concepts and practical experience building orchestration for data pipelines using modern toolchains such as GitHub, TeamCity, Jenkins, Ansible and Artifactory. Package Up to 20% bonus 25 days holiday BAYE, SAYE & Performance share schemes 7% pension Life Insurance Flexible benefits package Submit your CV now to be considered for this fantastic permanent opportunity in London. Tom Johnson is the consultant managing this assignment and can be contacted on 01612911458, ref 832781 Advantage Resourcing is a service driven recruitment consultancy. This job was originally posted as www.totaljobs.com/job/89687826