Senior
Senior
Senior
Senior
Senior
Site Reliability Engineer (AI/LLM & Infra)
Kubernetes
AI
LLM
AWS
Location
Remote
.svg)
Experience
Senior
You will be cooperating with a leading provider of AI evaluation and optimization solutions, trusted by multinational companies to optimize AI agents and detect performance issues in large language models.
Currently, we are developing advanced reinforcement learning (RL) environments and scalable evaluation systems that guide and shape the behavior of cutting-edge AI models. The company’s mission is to enable safe, verifiable, and aligned AGI through rigorous, real-world agent evaluation.
Due to the client’s time zone, we would appreciate a candidate who can work until 10:00 p.m.
Steps in the recruitment process
- HR call (max 10 min.)
- Call with Technical Manager (max 10 min.)
- Tech check with the Acai team (~ 40 min.)
- Technical interview(s) with our client (45 - 90 min.)
What will be your responsibilities?
- Build and maintain production agentic systems, including agent loop architecture, tool/function calling integrations, state management, and custom evaluation harnesses
- Produce high-quality, reproducible, production-level code that integrates cleanly into our client’s systems
- Develop infrastructure for task generation, synthetic data generation, verifiable reward design and tool simulations
- Creating and maintaining CI/CD processes and automating deploymentsDrive Infrastructure as Code practices using Terraform
- Work with customers on environment integrations, stepping in hands-on to unblock the team as needed
Requirements
- Ability to work 2:00 p.m. - 10:00 p.m. (CEST)
- At least 5 years of experience in a DevOps role, with a strong focus on infrastructure and reliability engineering
- Previous experience in working on AI/ML projects - MUST❗️
- Proven experience in building and maintaining production-ready agentic systems (including agent loop architecture, tool/function calling integrations, state management, and custom evaluation harnesses)
- Strong hands-on experience writing clean, scalable Python code
- Knowledge of relational databases (e.g., PostgreSQL), vector databases, and columnar databases
- Practice with AWS, K8s and Terraform
Nice to have:
- BS/MS in Computer Science, Mathematics, Statistics, or a related quantitative field
- Knowledge of Golang
160 – 230 PLN
netto per month - B2B
gross per month - Employment Contract
Our benefits
01.
Multisport
As we believe in polish saying "clean body, clean soul", we want to provide you with access to sport facilities that you prefer.
02.
Private healthcare insurance
As you join Acaisoft, you will be granted private insurance. If you have a family or a spouse - we can enable the private insurance for them as well.
03.
Internal initiatives
In Acaisoft, we regulary organize internal events such as game or movie nights, bar-hopping or sports.
.png)
04.
Top class equipment
Before your first day at work, our team will send you all of the equipment you will need. Our standard equipment includes MacBook Pro 16" with keyboard, mouse, headphones and external monitor(s).
.png)
Recruitment process
STEP 1
Application
After you apply, we will review your resume and get back to you. If your experience matches the requirements, we will schedule a quick screening call to get to know you.
STEP 2
Interview
After successful screening, you will be invited to interview with one of our delivery managers alongside with software engineer who will ask you technical questions.
STEP 3
Decision
After the interviews, we will get back to you as soon as possible with a feedback and, if all goes well, job offer. The feedback process usually takes upmost to 5 business days.
See similar jobs
We are constantly seeking for top talent all over the world. If you did not found the job position that suits your skills and experience, do not hesitate to contact us directly - we will be happy to talk to you about your future with us.
Senior Python Engineer (AI evaluations platform)
Senior
Senior
Senior
Senior
Senior
Remote
Backend
160 – 200 PLN
+ VAT (B2B) monthly
Python Engineer with C++ (AI project)
Senior
Senior
Senior
Senior
Senior
Remote
Backend
160 – 200 PLN
+ VAT (B2B) monthly
Python-Focused Fullstack (+React)
Senior
Senior
Senior
Senior
Senior
Remote
Fullstack
140 - 210 PLN
+ VAT (B2B) monthly
React Engineer with Tailwind (Vibe coding)
Senior
Senior
Senior
Senior
Senior
remote
Frontend
120 – 170 PLN
+ VAT (B2B) monthly
.svg)
Oops! Something went wrong while submitting the form.
.svg)
Since working with Acaisoft, our delivery velocity has increased at least 20 times. In the past months, we’ve done more developments than what had been done in the last four years in our company.
Pablo Verano
Head of Product
Scoopr