Sr. Data Engineer

Pandera Systems ,
London, Greater London

Overview

Job Description

Do you like data? Do you know how to take data and transform it to get meaningful data into end users hands? Do you enjoy taking complex problems and turn them into technical solutions that power Reporting Solutions, Advanced Analytics, and Data Sciences? We are looking for a Data Engineer to join our team of engineers, analysts, and architects focused on designing, building, and delivering data solutions that drive business decisions. As a Pandera Employee, you will have the opportunity to build world-class solutions to help our clients and partners solve challenging problems through data. Location - Remote working up to 5 days a week Coverage - 9am - 6pm GMT Primary Responsibilities: * Responsible for data modeling and schema design that will range across multiple business domains and industries * Partner with multiple client stakeholders including partners, business users, BI and Analytics teams * Work with teams to conduct workshops to identify data sources, flows, and requirements. * Create data pipelines for batch, micro-batch, and real-time data streams. * Coordinate work with client teams to ensure a smooth development and transition. * Conduct client workshops to help shape their future data strategy by providing future state architectures, roadmaps, and implementation plans. Basic Qualifications: * A minimum 4 years commercial experience working with Microsoft Azure data engineering tools to deliver Business Intelligence/Data Warehouse/Analytical data solutions using technologies such as Azure SQL Server, Azure Data Factory (v1-v2), Azure Data Lake and, Azure Storage. * A minimum 2 year commercial experience working with Azure Databricks. * Demonstrable usage and skills across T-SQL, JSON, Powershell, Spark and Python. * Hands on Data Vault 2.0 data warehouse design expertise. * Experience developing and deploying ETL processes and documentation including physical data model, source to target mappings, ETL packages (SSIS, Informatica, etc.). * Demonstrated mastery in database concepts and large-scale database implementations and design patterns * Implement solutions for structured, semi-structured, and unstructured data sources, relational and non-relational databases. * Experience working in Agile (Kanban and Scrum) environments. * Proven ability to work with users to define requirements and business issues using Agile methodologies. * Implementing Data Quality rules and test cases into a data environment * Excellent analytical and troubleshooting skills. Ideal Qualifications: * Experience with Dremio. * Hands on GIT and Azure DevOps experience. * Business Intelligence development experience using Microstrategy or Tableau. About Pandera Pandera is a global provider and singular source of expertise in the science and art of decision automation solutions and information delivery technologies. Pandera offers clients and their business partners a simple and repeatable method of automating and validating mission critical business decisions. Pandera's primary mission is to help organizations in the development of tools to manage and operate complex business units and functions, respond appropriately to challenging exceptions, and situational changes in real time with discrete role relevant analytical applications. Our solution advisors and delivery teams provide use of unmatched technology innovation and visualization techniques in conjunction with proprietary industry decision frameworks to ensure knowledge workers make choices and take action in the best interests of their organization.