We are looking for a Machine Learning Engineer (MLE) to design, build, and productionize ML evaluation and automation pipelines that support large-scale model development workflows.
The role involves working closely with algorithm developers, ML researchers, and product teams to build robust and scalable systems that automate model evaluations, manage distributed data processing, integrate human-in-the-loop validation processes, and produce actionable evaluation metrics. This position offers full ownership over the system’s architecture, implementation, scalability, and operational robustness, enabling efficient and rapid ML experimentation at scale.
Requirements
Must Have
- B.Sc. in Computer Science, Software Engineering, or a related technical field
- 3+ years of production-level Python development
- 3+ years building ML pipelines, data processing systems, or model evaluation infrastructure
- Strong system design skills and hands-on experience building distributed, scalable systems
- Experience with cloud compute platforms (Preferably Azure) — compute, storage, and networking
- Proficiency with:
- Containerized workloads (Docker, Kubernetes)
- SQL / NoSQL databases
- Experience integrating data annotation platforms or human labeling workflows
- Strong ownership mindset, able to independently design, build, and operate complex ML infra systems
Strong Advantage
- Experience with Computer Vision workloads and ML inference pipelines
- Experience building ML serving infrastructure and model deployment systems
- Familiarity with ML experiment tracking tools (Weights & Biases, ClearML, MLflow, etc.)
- Experience with video processing pipelines and encoding technologies
- Familiarity with cloud-native monitoring and observability stacks
Bonus
- Prior experience building evaluation or benchmarking pipelines for ML models
- Experience designing quality evaluation workflows for ML-based products
- Experience working in ML-heavy product companies or applied AI domains
Responsibilities
- Design and implement end-to-end ML evaluation pipelines supporting large-scale model assessments
- Build distributed data processing pipelines for ML inference, pre-processing, post-processing, and data transformation tasks
- Integrate human-in-the-loop annotation and validation systems as part of the evaluation workflow
- Design and implement scalable job orchestration, task dispatchers, and worker-based architectures for parallel ML workloads
- Manage storage, indexing, and retrieval of intermediate and final data artifacts
- Develop monitoring, logging, alerting, and observability for the entire pipeline
- Collaborate with algorithm and research teams to define flexible and reusable infrastructure components
- Automate manual and ad-hoc processes into robust, production-grade workflows
- Optimize resource utilization and ensure cost-effective pipeline operations.
Why this role
- Full ownership of designing critical ML infrastructure from the ground up
- Direct impact on ML development velocity and model quality
- Work with experienced ML researchers and engineers on production-grade systems
- Exposure to real-world applied AI workflows, cloud-scale systems, and automation challenges
What we offer
- Competitive salary range
- Medical insurance
- Paid vacation and sick leaves
- MultiSport card
- Top equipment kit, co-workings
- Hybrid set of works (Office location: Warsaw)
- Collaborative and innovative work environment
- Career growth and development opportunities
- A chance to work with giants of the sports industry
About the project
Our partner leads the industry in generating dynamic sports videos for every digital destination. Their cutting-edge AI and Machine Learning technologies analyse live sports broadcasts from over 250 leagues and broadcast partners, including iconic names like the NBA, NHL, ESPN, FIBA and Bundesliga, to create personalized, short-form videos in real-time.
The solution empowers media rights owners to unlock new revenue streams and deliver a tailored fan experience across every digital platform. Join the high-profile Engineering team and discover the forefront of sports contents innovation.
Job Type: Full-time
Pay: 25,000.00zł - 29,000.00zł per month
Work Location: In person
