Data Engineering Consultant - Financial Services

Asset Resourcing Limited ,
Edinburgh, City of Edinburgh
Job Type: Full-time
Salary: £55,000 per annum

Overview

Data Engineering Consultant: Our Client is looking for an experienced Data Engineering Consultant to join their existing DE practice. Based out of their Edinburgh HQ, you will work with their - typically - banking / insurance clients across the UK. Who they are: Our Client is a Data Management and Analytics consultancy, working with leading BI software vendors to enable clients to unlock value and insight from their data. They have over 100 consultants working across Retail / Investment Banking, Life & Pensions, and Insurance sectors around the UK. People are at the heart of everything they do. They invest heavily in the training and development of their team, hold monthly socials in each region, and regular lunches to catch-up with teams on site. What are they looking for: As a Data Engineering Consultant, you will have expertise in technical delivery, technologies and concepts in areas such as Data Storage, Data Ingestion, Data Integration, Data Warehousing, Data Preparation and Cloud Infrastructure. A suitable candidate will also have a wider understanding of how their role and delivery contributes to wider business outcomes and be able to concisely articulate to stakeholders and interested parties their role and solutions in a way that can be easily understood. Key Requirements: c5 years of experience in a data engineer role Expert SQL Skills Experience working with the Hadoop ecosystem (Spark, Hive/Impala, Databricks) Strong Programming background in Java, Scala, R or Python Experience in designing, developing and managing data pipelines to process large amounts of dataExperience of cloud based big data offerings such as Amazon EMR, Azure HDInsights or Google Dataproc Experience of cloud platforms such as Azure, AWS or GCP Experience working with an ETL tool e.g. Azure Data Factory, SSIS & Talend Understanding of data modelling techniques e.g. Kimball Experience working with data streams e.g. Kafka Experience working with large, structured and unstructured datasets Experience with database technologies (relational, NoSQL, graph) Expertise with version control e.g. git Flexibility to travel to and work on client sites within the UK and occasionally Europe. Excellent track record in executive stakeholder and sponsor management and maintaining valuable relationships. What you'll do: Work in collaboration with several Data Science & Data Engineering teams Help design and build data management solutions to provide data acquisition, data quality, data transformation, master data management and data integration of disparate sources for the data science ecosystem Work with data from a data lake or graph databases Help design and build dashboards, visualizations and analytics using tools such as Python, R, Qlik or Tableau Generate solution documentation for design, training and support purposes Work to a high standard of design and delivery within pre-determined timelines Provide regular and accurate progress reporting and communication to colleagues Work within Agile frameworks such as SCRUM Liaise with client stakeholders as appropriate for the role Excellent verbal and written communication skills using appropriate language and tools both internally and externally Willingness to take part in delivery of presentations, demonstrations, workshops or training sessions