Data Integration Developer - 100 Remote Working

SearchDATA ,
London, Greater London
More Details
Salary: £500 per day

Overview

Data Integration Developer 100% Remote Working - circa 6 month project - £500-600 per day SearchDATA Group have partnered with an international data consultancy to deliver a large scale Big-Data project in Madrid and as such are looking to recruit a Data Integration Developer for a 6 month project. The client is a prominent Financial Services institution that spans both Spain and Portugal. Ordinarily this role would be based on client-site in Madrid, but due to recent circumstances relating to Covid-19, all working will be remote for the foreseeable period. This will be for an initial 6 month period with a strong possibility to extend. We are looking for Data Integration developers with the following experience Essential Informatica Data Engineering, or at least Powercenter experience Hadoop Hive Scripting Useful to have Programming experience in Java / Python AWS EMR Spark Hbase Parquet Exposure to the banking / financial services industry The initial work will be Analysis of incoming data sets- matching file structure to copybooks/file headers File conversion from EBCDIC to ASCII (using a bespoke JAVA tool and scripting) Validation of expected file formats and ensuring files aren't corrupted Execute profiling through Informatica Data Engineering Quality The resources will then transition to ETL development Create informatica ETL workflows to load the data model in parquet on AWS EMR Develop transformations and calculation/derivation logic Create error handling reports Optimise jobs for performance Integrate with AirFlow for scheduling and orchestration SearchData Group is the first choice for Business Intelligence and Data Analytics recruitment across the UK and internationally. We work with Software Houses, Partners and End Users throughout the UK and Europe. As unique specialists in this niche marketplace we have positioned ourselves ideally to satisfy the needs of a variety of clients. We understand our industry and use our expansive network to position ourselves as market leaders for all data related requirements. Keywords - Data Integration Developer / Data Engineer / Database Developer / Data Consultant / BI Engineer / BI Developer / Data Architect

People also viewed