Product Features
Blog
Contact Us
Sign In
Infarm
,
London, Greater London
Data Engineer
Overview
Job Description
Who You Are As a data engineer, you will be responsible for developing data pipeline systems to connect new sensors and measuring systems to our cloud based infrastructure. You will work closely with multifunctional product teams, data scientists, software engineers, data engineers and machine learning engineers to develop resilient, event-based solutions to help our machine learning models to run at near-real time. * You're excited about our vision to reshape the food industry. * You believe diversity, collaboration and teamwork are key drivers for success. * You thrive in an environment where you can take ownership and solve hard problems. * You love a challenge and want to do well while doing good. * You want to expand your horizons and grow with us as we grow. Responsibilities * Create event based data pipelines to transfer and transform experimental and production level data to our cloud infrastructure. * Design systems to ensure fast data transfer across storage and processing infrastructure. * Design and develop resilient and scalable systems to ensure our systems can grow with our company's expansion plan * Enrich our data with internal and external APIs * Design and implement storage solutions to preserve the integrity of our data. Requirements * Bachelor of Science in Computer Science, Engineering, Statistics, or similar field * Professional experience designing and implementing data engineering solutions * Experience in cloud architecture and cloud-focused data engineering * Hands-on experience with software engineering best practices * Language skills: English full professional proficiency Special Things We Would Like to See * Experience with cloud-based infrastructure (Google Cloud Platform) preferred * Professional experience in DevOps or MLOps * Experience with Docker, Terraform and other deployment and infrastructure management tools. Location You will be based in our London plant hub, as well as our lab at Newcastle University