Senior
Senior
Senior
Senior
Senior

Python Engineer with C++ (AI project)

Python
C++
AI
Natalia Przybył
IT Recruiter
Location
Remote
Experience
Senior

You will be cooperating with a leading provider of AI evaluation and optimization solutions, trusted by multinational companies to optimize AI agents and detect performance issues in large language models.
In this role, you will be building the data, evaluation, and verification infrastructure for a competitive programming RL training environment. The role is focused on data engineering, sandboxed code execution, automated test generation, and grading systems rather than frontend or web development.

Due to the client’s time zone, we would appreciate a candidate who can work until 10:00 p.m.


Steps in the recruitment process
  1. HR call (max 10 min.)
  2. Phone call with Technical Manager (max 10 min.)
  3. Tech check with the Acai team (~ 30 min.)
  4. Technical interview(s) with our client (30 - 60 min.)

What will be your responsibilities?

  • Build and maintain scrapers for problems and submissions (AC, WA, TLE, MLE, RE).
  • Generate test suites using testlib across full constraint ranges.
  • Validate tests by ensuring accepted solutions pass, incorrect solutions fail, and that test suites are robust enough to verify the intended algorithmic approach rather than just output correctness.
  • Build and maintain the grading harness for compilation, execution, resource enforcement, and verdict generation.
  • Run model benchmarks and package evaluation results.

Requirements

  • Ability to work 2:00 p.m. - 10:00 p.m. (CEST)
  • 4+ years as a Python Engineer (data pipelines, orchestration, APIs, automation, and tooling)
  • Experience running untrusted code with resource limits, process isolation, timeouts, and execution monitoring
  • Ability to read, compile, and debug C++ code
  • Skills in building multi-stage pipelines (ingest → normalize → generate → validate → package), handling large datasets, schema validation, and deduplication
  • Ability to work with API Integrations (LLM APIs, rate limits, retries, concurrency, and batch processing)
  • Verification Mindset - strong focus on correctness, validation, testing, and benchmarking.
  • Docker and containerized execution environments

Nice to have:

  • BS/MS in Computer Science, Mathematics, Statistics, or a related quantitative field
  • Some experience with AWS (EC2, S3, batch processing)
  • RL training data or evaluation infrastructure knowledge
  • Experience in HuggingFace Datasets
  • Skills in the online judge systems (Codeforces, AtCoder, LOJ)

160 – 200 PLN

netto per month - B2B

gross per month - Employment Contract
Natalia Przybył
IT Recruiter

Our benefits

01.
Multisport
As we believe in polish saying "clean body, clean soul", we want to provide you with access to sport facilities that you prefer.
sports
02.
Private healthcare insurance
As you join Acaisoft, you will be granted private insurance. If you have a family or a spouse - we can enable the private insurance for them as well.
health
03.
Internal initiatives
In Acaisoft, we regulary organize internal events such as game or movie nights, bar-hopping or sports.
lightbulb
04.
Top class equipment
Before your first day at work, our team will send you all of the equipment you will need. Our standard equipment includes MacBook Pro 16" with keyboard, mouse, headphones and external monitor(s).
workspace premium

Recruitment process

STEP 1
Application
After you apply, we will review your resume and get back to you. If your experience matches the requirements, we will schedule a quick screening call to get to know you.
create
STEP 2
Interview
After successful screening, you will be invited to interview with one of our delivery managers alongside with software engineer who will ask you technical questions.
question_answer
STEP 3
Decision
After the interviews, we will get back to you as soon as possible with a feedback and, if all goes well, job offer. The feedback process usually takes upmost to 5 business days.
forward_to_inbox

See similar jobs

We are constantly seeking for top talent all over the world. If you did not found the job position that suits your skills and experience, do not hesitate to contact us directly - we will be happy to talk to you about your future with us.

Senior Python Engineer (AI evaluations platform)

Senior
Senior
Senior
Senior
Senior
location
Remote
Backend
160 – 200 PLN
+ VAT (B2B) monthly
Python
AI
API
APPLY

Site Reliability Engineer (AI/LLM & Infra)

Senior
Senior
Senior
Senior
Senior
location
Remote
DevOps
160 – 230 PLN
+ VAT (B2B) monthly
Kubernetes
AI
LLM
AWS
APPLY

Python Engineer

Regular
Regular
Regular
Regular
Regular
location
Pune, India
Python
14$/ hour
+ VAT (B2B) monthly
Python
APPLY

Python-Focused Fullstack (+React)

Senior
Senior
Senior
Senior
Senior
location
Remote
Fullstack
140 - 210 PLN
+ VAT (B2B) monthly
Python
React
AI
APPLY

Senior Machine Learning /AI Engineer (RL)

Senior
Senior
Senior
Senior
Senior
location
Remote
Machine Learning
170 - 230 PLN
+ VAT (B2B) monthly
Python
Langchain
APPLY

React Engineer with Tailwind (Vibe coding)

Senior
Senior
Senior
Senior
Senior
location
remote
Frontend
120 – 170 PLN
+ VAT (B2B) monthly
React
Tailwind
AI
APPLY

Got a question?

Join Acaisoft & let's start our adventure together!
Natalia Przybył
Recruiter
We use our own and third-party cookies. By continuing to navigate, we understand that you accept our cookies policy. More info here

Contact us

Thank you
Your message has been sent.
We will respond to you within 24 hours.
HOME
Oops! Something went wrong while submitting the form.
Since working with Acaisoft, our delivery velocity has increased at least 20 times. In the past months, we’ve done more developments than what had been done in the last four years in our company.
Customer Avatar
Pablo Verano
Head of Product
Scoopr
close