Product Features
Blog
Contact Us
Sign In
Square Enix
,
London, Greater London
Senior Data Engineer (Contract)
Overview
Job Description
Square Enix has an internal cloud-based platform, which provides our Analytic & Insight team and other groups across the business with a single data lake pooling game telemetry, sales and marketing data, web analytics and other information. The Senior Data Engineer leads the team responsible for maintaining and further developing this platform. Data Engineering are a small dynamic team within the broader Online Development department. We specialise in creating data processing systems which integrate with the wider reporting channels in the company, creating and maintaining a central data repository for player data commonly referred to as SGV. We also provide integration between SGV and external tools and BI solutions as well as aiding other teams with our expertise. Key Deliverables * Mentor the Data Engineering team and function within the Online Development department. * Ensure the Data Engineering team deliver on requests from client teams to agreed specification and time lines. * Ensure open and regular communication with other stakeholders as to the status of their projects. * Work to ensure Data Engineering team is capable to deliver against responsibilities. Maintain a learning culture within the team to enable individual team members to continue to grow professionally and to develop their skills * Ensure data is robust and of high quality. * Provide data access and querying support to users both within the team and across the business. * Have a good understanding of the scope, potential and limitations of the datasets maintained by the Data Engineering team, remaining alert to any opportunity to further employ our data to benefit the business. * Evangelise the use of customer data to better understand our customers across the organisation. * Maintain strong relationships with technical partners at Google, Amazon, Microsoft, Sony etc. to ensure Square Enix capability remains at the forefront of the industry. * To represent the team professionally at all times both internally and externally. Requirements Essential: * High-level of professional experience with cloud-based data engineering platforms, particularly Google Cloud Platform (DataFlow, BigQuery, PubSub, GCS). * Expertise with lambda architecture and other approaches to capture and processing of data at scale to provide real-time analytics capability. * Comfortable familiarity working with large data sets. * Expert SQL skills. * Excellent problem solving & analytical skills. * Excellent programming skills in Java (8 preferable) & Python essential, other languages an advantage. * Experience modelling ETLs using Apache Beam. * Experience writing near real-time ETLs. * Experience with multiple build tools, preferably gradle * Familiarity with OSX or Linux environment (shell scripting, basic system administration etc). * Experience with managing a code base and using source control/collaboration tools such as GitHub, Bitbucket or GitLab. * Familiarity with collaboration and communication tools such as JIRA, Confluence, Slack etc.