Senior
Senior
Senior
Senior
Senior

Senior Machine Learning /AI Engineer (RL)

Python
Langchain
Natalia Przybył
IT Recruiter
Location
Remote or hybrid (Warsaw)
Experience
Senior

You will be cooperating with a leading provider of AI evaluation and optimization solutions, trusted by multinational companies to optimize AI agents and detect performance issues in large language models.
In this role, you’ll help develop advanced reinforcement learning (RL) environments and scalable evaluation systems that guide and shape the behavior of cutting-edge AI models. The company’s mission is to enable safe, verifiable, and aligned AGI through rigorous, real-world agent evaluation.

Due to the client’s time zone, we would appreciate a candidate who can work 12 p.m. - 8 p.m.

This is a 100% remote position, but if you enjoy working from an office, you’re warmly welcome to join us there too 😊


Join us and make a real impact!

If you’re ready to broaden your horizons and work with an innovative company at the forefront of AI, we’d love to hear from you. You’ll help build the environments that shape how future AI systems are trained, evaluated, and aligned - and collaborate with world-class engineers and researchers on one of the most important technical challenges of our time.

Steps in the recruitment process:

  1. HR call (max 15 min.)
  2. A quick check-in with our VP of Delivery (max 15 min.)
  3. Meeting with our client (+/-30 min.)

Our benefits:
Our main benefits include private medical care and co-financing for a sports card. Our recruiter will be happy to share more details about additional perks during the recruitment process 🙂

What will be your responsibilities?

  • Designing and deploying large-scale, fault-tolerant AI inference services and distributed systems to support real-time voice agents.
  • Leveraging and orchestrating Foundational Models using tools like LangChain, LangGraph, including state-of-the-art prompting, agent design, and RAG (Retrieval-Augmented Generation) techniques.
  • Working with Reinforcement Learning (RL) techniques and implementing Continuous Learning/Online Optimization systems for production.
  • Architecting solutions using microservices and asynchronous messaging technologies like Kafka, Azure ServiceBus, etc. (critical for high-volume, real-time interactions).

Requirements

  • 6+ years of experience in Python software engineering.
  • Minimum 3 years in Machine Learning/Environment Engineering, Data Scientist roles.
  • Practical knowledge of AI frameworks (Langchain, Langraph, mcp-server ).
  • Extensive practical experience in working with AI, including prompt engineering and vibe coding.
  • Experience in working with business requirements (analysis, summarizing, responding to changes).
  • Expertise in planning your own work or that of a small team.

Nice to have:

  • Knowledge of Codex or Claude Code.
  • Experience in integrating AI with a system would be an advantage.
  • Understanding of RL concepts - reward modeling, environment dynamics, verifiability, evaluation, and agent interaction loops.
  • Familiarity with instrumentation, metrics, and data pipelines for RL evaluation.

150 - 250 PLN

netto per month - B2B

gross per month - Employment Contract
Natalia Przybył
IT Recruiter

Our benefits

01.
Multisport
As we believe in polish saying "clean body, clean soul", we want to provide you with access to sport facilities that you prefer.
sports
02.
Private healthcare insurance
As you join Acaisoft, you will be granted private insurance. If you have a family or a spouse - we can enable the private insurance for them as well.
health
03.
Internal initiatives
In Acaisoft, we regulary organize internal events such as game or movie nights, bar-hopping or sports.
lightbulb
04.
Top class equipment
Before your first day at work, our team will send you all of the equipment you will need. Our standard equipment includes MacBook Pro 16" with keyboard, mouse, headphones and external monitor(s).
workspace premium

Recruitment process

STEP 1
Application
After you apply, we will review your resume and get back to you. If your experience matches the requirements, we will schedule a quick screening call to get to know you.
create
STEP 2
Interview
After successful screening, you will be invited to interview with one of our delivery managers alongside with software engineer who will ask you technical questions.
question_answer
STEP 3
Decision
After the interviews, we will get back to you as soon as possible with a feedback and, if all goes well, job offer. The feedback process usually takes upmost to 5 business days.
forward_to_inbox

See similar jobs

We are constantly seeking for top talent all over the world. If you did not found the job position that suits your skills and experience, do not hesitate to contact us directly - we will be happy to talk to you about your future with us.

Senior Python Engineer

Senior
Senior
Senior
Senior
Senior
location
Remote
Backend
130 – 160 PLN
+ VAT (B2B) monthly
Python
FastAPI
APPLY

Junior AI Engineer

Junior
Junior
Junior
Junior
Junior
location
Remote
AI
45 – 70 PLN
+ VAT (B2B) monthly
Python
LLM
APPLY

Junior DevOps Engineer

Junior
Junior
Junior
Junior
Junior
location
remote
DevOps
45 – 70 PLN
+ VAT (B2B) monthly
Python
APPLY

Junior/Mid Python Engineer

Regular
Regular
Regular
Regular
Regular
location
Remote
Backend
40 - 80 PLN
+ VAT (B2B) monthly
Python
Terraform
APPLY

Got a question?

Join Acaisoft & let's start our adventure together!
Natalia Przybył
Recruiter
We use our own and third-party cookies. By continuing to navigate, we understand that you accept our cookies policy. More info here

Contact us

Thank you
Your message has been sent.
We will respond to you within 24 hours.
HOME
Oops! Something went wrong while submitting the form.
Since working with Acaisoft, our delivery velocity has increased at least 20 times. In the past months, we’ve done more developments than what had been done in the last four years in our company.
Customer Avatar
Pablo Verano
Head of Product
Scoopr
close