Senior Data Engineer

ElectraLink ,
Nottingham, Nottinghamshire
Salary: From £50,000 to £70,000 per annum Bonus, Annual Leave, Pension, Health

Overview

This is a full-time, permanent position located in our Nottingham office. The annual salary is up to £70,000 DOE, with up to 10% bonus and benefits. We are currently running a virtual office for the foreseeable future. Our recruitment drive is continuing with new hires joining us using our remote working capabilities. All interviews will be conducted via Skype Video. We ask candidates have access to a webcam for them to be able to attend interviews. Job Summary The Insight Developer will create and support new and current insight products for EMI services. The role will report to the Head of Service Development and have the responsibility for the development life-cycle process including creation of cloud-based infrastructure, product definition, development, testing and implementation into production. Responsibilities Responsible for the development of the Energy Market Insight product portfolio. Supporting sales initiatives and developing innovative technical solutions that meet client and market requirements Creating and maintaining new performant, secure and value based public cloud infrastructure that meets ElectraLink design principles to support the development, testing and operation of new products and services. Translating requirements into technical solutions for new data services including data acquisition, transformation, matching, enrichment, anonymization, secure access and presentation. Building, testing and automating new data services that integrate multiple data sources. Working with team colleagues, the ElectraLink test team and external partners to ensure performance and accuracy of outputs to meet client needs. Developing custom and self-service BI reporting capabilities using COTS tools such as Tableau. Maintaining a broad knowledge of the technical solutions and standards available in the energy and smart metering market. Skills & Knowledge Key skills Experience in data acquisition, enrichment and matching using COTS ETL tools such as Pentaho and Informatica Experience of operating and managing AWS cloud environments (infrastructure as code) with a focus on performance, value for money and security. Knowledge of logical and physical data modelling techniques Knowledge of approaches to data masking and anonymization to support data security and privacy requirements Experience in developing custom and self-service BI reporting capabilities using COTS tools such as Tableau and QlikView as well as SQL. Highly desirable skills Experience in “big data” platforms (e.g. Hadoop) and traditional RDBMS technologies Experience in working in an agile / scrum “fail-fast” environment Experience of using AWS CodeCommit Able to deal with structured, unstructured and semi-structured data Development and articulation of solution design both verbally and in writing e.g. option papers. This job was originally posted as www.totaljobs.com/job/89934104