Data Engineer, London

DMW Group ,
London, Greater London

Overview

Job Description

Would you like to help create a brand-new engineering organisation? Perhaps you know what great engineering culture looks like, or you have an entrepreneurial side as well as outstanding coding skills? Whatever your aspirations, were trying to create the best engineering consultancy in the UK and looking for brilliant engineers to be part of the journey. About DMW Engineering DMW helps organisations solve their biggest, most exciting engineering problems. Weve created banks from scratch on Kubernetes and AWS, built streaming analytics solutions that protect the country and built platforms to enable whole organisations to move to AWS and Azure, and everything in between. We do all this in a work environment where regular social events, inclusivity and an ego-free culture mean weve been officially voted a Great Place to Work for five years in a row. Were not interested in cutting corners and believe in helping our clients to make the right choice for the long-term. We draw on our reputation for outstanding delivery to allow our engineers to do the right thing for our clients, and not necessarily the easy thing. Innovation is in our DNA, and we encourage our engineers and consultants to work together to rethink conventional wisdom on how problems should be solved. Location: Based in the vibrant and modern Labs House, we are a stones throw away from Holborn station. Boasting coffee lounges, co-working spaces, ping pong/table tennis tables, free on-site gym and weekly yoga classes all the way through to fortnightly free breakfasts. Heres what you will do (Not all of it, but some of the important stuff!) * Solve the problems others cannot * Spend a day a week working on a combination of internal products and your own development * Create data platforms based around modern open source products and cloud-native technologies: * AWS, Azure and Google Cloud * Python * Kafka / NiFi / Flume * DB technologies: SQL Server / PosteSQL / MySQL * Hive/Spark/Impala * Dataiku * Terraform * Kubernetes Requirements The essentials? * Experiece building data platforms using either cloud native products or commercial data analytics / data warehouse software * Working knowledge of data pipelines & data transformation processes * Experience creating and/or maintaining production software delivery pipelines using common CI/CD tools (e.g. Jenkins, GoCD, CircleCI) * Demonstrable experience in automating operations tasks with one or more scripting languages * Experience working with one or more of the main cloud providers (AWS, Azure or Google) * Have a drive for self-improvement and learning, including learning new programming languages * Approach solving problems pragmatically * Experience of Hadoop big data platforms (either Cloudera / Hortonworks or cloud native equivalents) * Experience with data reporting and visualisation tools (PowerBI, Tableau, Qlik) * Experience productionising machine learning algorithms * Experience with Infrastructure as Code (e.g. Terraform, Cloudformation) * Experience supporting and operating production systems * Familiarity with configuration management tooling (e.g. Ansible) It would be great if you had these desirable skills * Experience of Hadoop big data platforms (either Cloudera / Hortonworks or cloud native equivalents) * Experience with data reporting and visualisation tools (PowerBI, Tableau, Qlik) * Experience productionising machine learning algorithms * Experience with Infrastructure as Code (e.g. Terraform, Cloudformation) * Experience supporting and operating production systems * Familiarity with configuration management tooling (e.g. Ansible) Benefits Weve grown consistently over the years and offer an entrepreneurial environment within which to embark upon an exciting career path, where your contribution really counts, and we will recognise it. With personalised development opportunities, experienced colleagues and challenging client assignments, progression can be extremely rapid for high performers. We are a social bunch of people and go out as a team on a regular basis. You can also expect: * A highly collaborative working environment and great rates of pay (including base salary and bonus potential). * A range of flexible benefits consisting of well-being and lifestyle benefits. * A commitment to your development & continuous growth of skills through one-to-one mentoring and wide-ranging hands-on experience. * 25 days holiday and the ability to flex this to 30 days if you chose to do so. * 2 days CSR volunteering days. * Award-winning learning and development opportunities, including dedicated personal training budgets and time and a wide range of choice in training courses. * A dedicated personal budget to choose the IT equipment of your choice.