Senior Data Engineer

Streamhub ,
London, Greater London

Overview

Job Description

Who we are? Streamhub is a London startup building the next generation SaaS platform to make online video audiences happier. Our media customers entrust us with multiple data sources that need the right modeling and analysis to generate the necessary value to lead to satisfying viewing experiences and advertisers. This comes in the form of billions of video viewing data points and associated behavior data to profile and segment users for happy growth. About This Role Job Type: Full Time Experience level: Senior Industry: Audience profiling, Ad / Mar Tech, Video streaming, Analytics Company size: 11-50 Company type: Private This role will give you a challenging opportunity to build an innovative data product as the senior engineer of our core technology team. You will be in a senior role of a small and highly-productive data engineering team that has a fun and strong work ethic who believe in fast, iterative development as a startup. You will be in a flat organization where the focus is on engineering challenges to build versatile data pipelines that deal with volume and diversity of data, including time spent on advanced analysis including machine learning and adopting newer technologies to build strong technical foundations. Qualifications - You are: * Passionate about growing data * 3+ years of operational, design and development experience in online analytical processing systems, like Apache Druid, Pinot, Clickhouse, Snowflake. * Expert in Scala and/or Java with proven production-level experience in analytics, building data pipelines, and automation. * Expert with NoSQL databases (e.g. Cassandra, Mongo) and search engines, including operations. * Experienced with in-stream and real-time data processing technologies and architecture. * Experienced with distributed computing Apache Spark or Hadoop. * Expertise in the design, creation, and optimization of large datasets and logical data models. * Experience with big data enabling technologies on AWS - EMR, Kinesis, Elastic Beanstalk, Lambda, Athena, Redshift. * Experience in some popular machine learning algorithms will be a big plus. Why you should join us? * A proper 'big data company' - When we talk about a large system, we really mean it. Our platform generates traffic that measures in millions of messages every hour. * Opportunity for growth - Build your knowledge as our team and business grow. Our product touches many different modern technologies and we are working every day towards a better solution. We will help you grow in areas you love and we look to you for our own growth too. * Culture of team and value creation - We are a small dynamic team working well together in a transparent way and helping each other to overcome problems. This, in turn, delivers immediate value to the real world. We take pride in what we have achieved so far living by our values. * Proven colleagues - Whilst there's a lot of hype in the market for startups that come and go, we have achieved everything by boot-strapping and delivered on incredible deals where entire markets depend on our product. We are now looking to grow into the next phase with you. Our Everyday 'Keywords' (after a heavy shuffle!) Team - Analytics - Media - Customers - Scala - Apache Spark - Kinesis - Videos - AWS - Innovation - Cassandra - MongoDB - Elasticsearch - Angular - DMPs - Clickhouse - Streaming - Apache Druid - Vision - Serverless - feedbacks - Python - Akka - OLAP - Lambda - AdTech - Microservice - Look-Alike - Grafana - Orchestration - Automation - Predictive models - Terraform - Docker - Data lake Our Offer * Full-time employment/ starting April-May 2020. * Salary: circa 60-82K. * Generous stock options: up to 1% EMI share options depending on seniority. * Great kit, cool office space, plenty of self-learning resources. * Sponsorship to attend tech events and certification exams. * Opportunity to travel between our London and Tokyo offices. * Modern team with flexible working hours. * Paid relocation. * We offer Tier2 VISA sponsorship for non-UK nationals with exceptional fit to the position as part of the package. * Immense learning!