Senior Machine Learning /AI Engineer (RL)
.svg)
You will be cooperating with a leading provider of AI evaluation and optimization solutions, trusted by multinational companies to optimize AI agents and detect performance issues in large language models.
In this role, you will work on generating tasks in Reinforcement Learning environments. We create environments for producing training data that can be used to train models.
The company’s mission is to enable safe, verifiable, and aligned AGI through rigorous, real-world agent evaluation.
Due to the client’s time zone, we would appreciate a candidate who can work 2 p.m. - 10 p.m.
This is a 100% remote position.
Join us and make a real impact!
If you’re ready to broaden your horizons and work with an innovative company at the forefront of AI, we’d love to hear from you. You’ll help build the environments that shape how future AI systems are trained, evaluated, and aligned - and collaborate with world-class engineers and researchers on one of the most important technical challenges of our time.
Steps in the recruitment process:
- HR call (max 15 min.)
- Technical skills assessment via discussion of a short case study (no coding required!!)
- Technical interview with our client (max 30 min.)
What will be your responsibilities?
- Designing and deploying large-scale, fault-tolerant AI inference services and distributed systems to support real-time voice agents.
- Leveraging and orchestrating Foundational Models using tools like LangChain, LangGraph, including state-of-the-art prompting, agent design, and RAG (Retrieval-Augmented Generation) techniques.
- Working with Reinforcement Learning (RL) techniques and implementing Continuous Learning/Online Optimization systems for production.
- Architecting solutions using microservices and asynchronous messaging technologies like Kafka, Azure ServiceBus, etc. (critical for high-volume, real-time interactions).
Requirements
- 6+ years of experience in Python software engineering.
- Minimum 3 years in Machine Learning/Environment Engineering, Data Scientist roles.
- Practical knowledge of AI frameworks (Langchain).
- Extensive practical experience in working with AI, including prompt engineering and vibe coding.
- Experience in working with business requirements (analysis, summarizing, responding to changes).
Nice to have:
- Knowledge of Codex or Claude Code.
- Experience in integrating AI with a system would be an advantage.
- Understanding of RL concepts - reward modeling, environment dynamics, verifiability, evaluation, and agent interaction loops.
- Familiarity with instrumentation, metrics, and data pipelines for RL evaluation.
170 - 230 PLN
Our benefits
.png)
.png)
Recruitment process
See similar jobs
Senior Python Engineer (AI evaluations platform)
Python Engineer with C++ (AI project)
Python Engineer
Python-Focused Fullstack (+React)
.svg)
.svg)
Since working with Acaisoft, our delivery velocity has increased at least 20 times. In the past months, we’ve done more developments than what had been done in the last four years in our company.
