Senior Software Engineer

Vortexa ,
London, Greater London
More Details

Overview

Job Description

The Challenge... Ingesting hundreds of rich data points per second from many vastly different external sources, moving terabytes of data while processing it in real-time, running complex and complicated prediction and forecasting AI models while coupling their output into a hybrid human-machine data refinement process and presenting the result through a nimble low-latency SaaS solution used by customers around the globe is no small feat of science and engineering. This processing requires a highly reliable, stable, fault-tolerant infrastructure and data pipelines that can withstand multiple and varied uses and abuses by data analysts, data scientists, industry experts, and the end-users. The Predictions and Market Modelling Team are responsible for generating high-value forecasts that enrich our data products. We have built a wide variety of data processing pipelines including state of the art Machine Learning models to predict the operations of the >10,000 tankers tracked by our system, which have enabled us to provide the most accurate and comprehensive view of global oil and gas flows. We take pride in applying cutting-edge research to the real-world problems in a robust, long-lasting and maintainable way. The quality of our data is continuously benchmarked and assessed by experienced market and data analysts to ensure the quality of our predictions. We use a wide variety of technologies like Python/Numpy/sklearn/Tensorflow/Pandas, Java/Kotlin/Scala, Airflow, Apache Kafka and Kafka Streams, Elastic Search, Kubernetes, Jupyter, and AWS services like AWS Sagemaker, MSK, RDS, Athena and others. You'll be instrumental in designing, implementing and testing code that allows historically niche research to be elevated to the real-world scale. Working with data scientists, analysts, engineers and experts, you'll help bridge the gap between scientific experiments and commercial products by ensuring 100% uptime and bulletproof fault-tolerance of every component of the infrastructure. In addition to this, you'll work closely with team members to implement best practices in our key technologies. We are: * A vibrant, diverse company pushing ourselves and the technology to deliver beyond the cutting edge * A team of motivated characters and top minds striving to be the best at what we do at all times * Constantly learning and exploring new tools and technologies * Acting as company owners, which all of us are - in a business-savvy and responsible way * Enjoying a friendly working environment * Motivated by being collaborative, working and achieving together * Not only teammates but friends, often finishing the week enjoying a glass of a favourite drink and a game of 3D Connect 4 together * Offering a generous salary and equity Requirements You are... * Driven by working in an intellectually engaging environment with the top minds in the industry, where constructive and friendly challenges and debates are encouraged, not avoided * Experienced influencer and patient evangelist of the cutting edge and yet pragmatic software engineering best practices * Passionate about writing elegant, modular code, underpinned by well-defined contracts, that can withstand the test of time * An expert in Python/Numpy/Pandas * Experienced in Java or other JVM languages like Kotlin or Scala * Experienced in using distributed systems, including real-time streaming and batch data processing * A graduate in Computer Science or equivalent (advanced degree a plus) * Not afraid of challenges and infrastructure troubleshooting * Excited about working in a start-up environment * Motivated by bringing new ideas to production * Self-sufficient but not afraid to ask for help when needed * A thinker who likes to push the boundaries of their job role Awesome if you: * Are a natural technical mentor and authority, who people gravitate to for advice and opinion * Have experience with Apache Kafka and Kafka Streams - deployment, monitoring, resiliency, fault-tolerance, cluster planning and operations, applications debugging * Are skilled with Kubernetes * Have experience with Machine Learning research and development projects * Are familiar with Airflow or other workflow orchestration tools * Have some relevant AWS or Kafka certifications * Understand data lakes like Parquet, Orc, Athena Benefits We offer: * A competitive remuneration package * Stock options in a fast-growing, high-potential business * Private Health Insurance * Work Perks - discounted travel and cinema tickets, shopping and travel. * The opportunity to work with industry experts on the leading edge of artificial intelligence in commodity trading * A working environment built on merit, which celebrates creative thinking and collaborative achievement

People also viewed