📍 Spain · Fully remote · Spanish employment contract
Seniority level: Mid-Level
Employment type — Full-time
Eticas.ai evaluates socio-technical AI systems in the environments where they actually run. For over more than a decade we have been evaluating AI systems in production, and we have turned that expertise into a product: the Eticas.ai platform, which supports independent evaluation, continuous monitoring and periodic re-evaluation of AI systems.
The Eticas.ai platform is built on top of our Eticas Risk Taxonomy and our methodology, and is used by our team of evaluators - empowered to perform evaluations and monitoring of AI systems with a repeatable and effective process that respects the uniqueness of each system - and by our clients, who get concrete actionable results of their system evaluations online (the Evaluation Brief).
As a full-stack engineer, you will work with the current engineering team that has developed the platform and be a key contributor to the evolution of existing modules and the development of new ones. You will also have the opportunity to contribute to shape the product roadmap, working very closely with the team that defines our standards (taxonomy and methodology) to turn the rigor of our evaluations into our engineering system.
You will contribute to the continuous monitoring of AI systems by working with Eticas’s AI evaluation team to design and build the pipelines that re-run evaluations on a schedule, the integrations with clients’ LLM-based and agentic systems, and the detection of changes in a system’s behavior between runs. We encourage the use of AI tools in the platform’s monitoring and detection processes, and you will have room to propose and build new features that use them.
We are a small team in a very dynamic environment, so you would need to feel comfortable working without very clear detailed specifications and in an environment where priorities may quickly change. If you’d be excited by building a product that matters in the cutting edge of AI evaluation, writing new rules as opposed to following them, this position is for you.
How we work
We are a fully remote team, spread across time zones and continents, but we work very closely together. We stay aligned through regular team syncs and check-ins, and we default to clear, proactive communication and organized documentation, so distance never becomes disconnection.
We give people real flexibility in how and when they work. In return, we expect real ownership: you are accountable for outcomes, not hours online. It is a team built on trust, where independence and collaboration reinforce each other. English is our working language.
Who we are looking for
We care more about how you think than about a perfect CV. The person who thrives here:
Takes ownership without being told to: sees a gap, a risk or a broken pipeline and raises it.
Is entrepreneurial by temperament: energized, not unsettled, by a small team, limited structure and real responsibility.
Is a builder who enjoys designing what does not exist yet. There is no established playbook for continuous, verifiable AI evaluation.
Communicates proactively: raises questions before a problem becomes urgent and gives a small team clear, unprompted status updates.
Cares about getting AI right. You do not need to be an ethicist, but you should want the evidence the platform produces to hold up.
Is based in Spain and comfortable working fully remotely with limited day-to-day oversight.
On paper, we would expect around 4 or 5 years of relevant experience, but we will take the right attitude over a perfect CV.
Key responsibilities
Understand the existing modules of the Eticas.ai platform and its operation, with the goal to be in a position to eventually lead its development cycles.
Translate high level functionality and new evaluation methods into engineering requirements for new modules of the platform as they get prioritized in the roadmap. Build such platform modules and deploy them in production. Support the client operations team to integrate the platform with clients’ systems and environments (APIs, data pipelines, model endpoints), securely and reliably.
Write and maintain automated tests, so that changes to the platform do not alter evaluation results.
Make every evaluation run reproducible and traceable: which data, which version of the method and which version of the client’s system produced each result.
Maintain the modules in production, fix defects and respond to incidents.Keep clear and dependable documention so anyone on the team can see where it stands and what comes
Requirements
Based in Spain, with the right to work there. This role is offered under a Spanish employment contract.
Fluency in English (written and spoken); Spanish is a plus.
4+ years building and running production software, ideally including a SaaS or data platform.
Strong in Python and TypeScript/Node, with experience building back-end services and data pipelines.
Cloud infrastructure (AWS preferred), containers, CI/CD, job orchestration and observability.
Experience designing APIs and integrating with third-party systems, including authentication and authorization.A working understanding of how ML and LLM systems are built, tested and monitored. Hands-on MLOps or LLM-evaluation tooling is a strong plus.
Comfort using AI tools for scale while maintaining judgement and original thinking (read our AI usage policy).
Comfort working independently and proactively in a small, remote, fast-moving team.
Nice to have (and something we will assess)
Front-end experience, enough to ship a feature end to end.
Experience with automated testing of production software.
Multi-tenant systems and audit trails.
Product sense: turning a fuzzy client need into a scoped feature, and explaining trade-offs to non-engineers.
Interest in AI evaluation methodology: how metrics, thresholds and scoring turn test results into a judgement a client or regulator can trust.
An engineer who brings product and methodology thinking alongside strong engineering would be the ideal candidate.
How to apply
Send one email to careers@eticas.ai with the subject line “Platform Engineer: [your full name]” and two separate attachments: your CV and your cover letter. Please also include a link to something you built that you are proud of (a repo, a product, a design doc). Applications that do not follow these instructions will not be reviewed.
Who we are
We are a mission-driven company founded in 2012 as one of the first firms dedicated to AI auditing. We perform independent AI system evaluation and monitoring. Our socio-technical team, empowered by the Eticas.ai platform, evaluates AI systems end to end, in the production environments where they actually run, turning rigorous evidence into practical tools for responsible AI development and deployment.
Eticas.ai has completed more than 200 evaluations across 15+ industries, with clients across four continents, covering expert and predictive systems, LLM-based systems, and agentic systems. Our work follows a repeating cycle of independent evaluation, continuous monitoring, and periodic re-evaluation, giving organizations verifiable evidence that their AI is doing what it was designed to do, while remaining fair, safe, and accountable.
Eticas.ai is the sister organization of Eticas Foundation, a non-profit whose mission is to build public-interest auditing capacity through community-led audits and shared evidence on AI harms.
Our public evaluation library on GitHub: github.com/eticasai/eticas-audit
Our latest research: "The Eticas AI Risk Taxonomy: Open Infrastructure for Operationalizing AI Audits" (arxiv.org/abs/2607.02201)