The evaluation of Allegheny County’s homelessness risk tool examined performance and potential disparities across protected groups. The insights led to stronger monitoring, clearer procedures, and better guidance for teams using the system in practice.

The FINDHR project introduced practical tools, guidelines, and auditing frameworks designed to reduce discrimination in AI-assisted hiring. These resources support more transparent, inclusive, and accountable recruitment practices across Europe.

Our Founder and CEO delivered the closing keynote at the DLA Piper European Technology Summit, bridging into the announcement of DLA Piper's AI campaign. DLA Piper's testimonial: "Gemma was absolutely brilliant on the day. Her energy and delivery really captured the room, and she created a seamless bridge from her closing keynote into the announcement of our AI campaign. She's a dynamic and engaging speaker."

Gemma Galdon Clavell speaks at the UNESCO Expert Roundtable II: Capacity Building for Competent Authorities on AI, in the session "Tools for Supervising Authorities: Understanding Algorithm Audits," addressing EU data protection and market surveillance authorities.

Gemma joined Shea Brown at RightsCon 2025 to present "Covering the Last Mile of Accountability and Oversight: AI Auditing," on the critical role of AI auditing in ensuring accountability and transparency.

Artificial intelligence (AI) models are increasingly autonomous in decision making, making the pursuit of responsible AI more critical than ever. Responsible AI (RAI) is defined by its commitment to transparency, privacy, safety, inclusiveness, and fairness. But while the principles of RAI are transparent and shared, RAI practices and auditing mechanisms are still incipient. A key challenge is establishing metrics and benchmarks that define performance goals aligned with RAI principles. This paper presents how the ITACA AI auditing platform incorporates demographic benchmarking for AI recommender systems to identify and measure bias. We propose a Demographic Benchmarking Framework to measure populations potentially affected by specific models, set acceptable performance ranges, and guide policymakers and developers. Our approach integrates socio-demographic insights directly into AI systems, reducing bias while also improving overall performance. The main contributions of this study include: 1. Defining control datasets tailored to specific demographics so they can be used in model training to quantify sampling bias; 2. Comparing the overall population with those impacted by the deployed model to identify discrepancies and account for structural bias; and 3. Quantifying drift in different scenarios continuously and as a post-market monitoring of deployment bias.

Since 2023, New York City's Local Law 144 has required employers to run independent bias audits on any automated employment decision tool (AEDT) used in hiring. At Eticas.ai, we built ITACA_144 — a version of our broader bias-auditing platform, ITACA_OS — to help employers meet this requirement. Along the way, we surfaced several structural gaps in the law that limit how effective it can be, and we believe those lessons are relevant well beyond New York.

Interview from New York on algorithmic auditing, the European AI Act, and regulatory comparison with the US and China. The video is referenced within the article ('Watch video').

Full interview (44 min) on training AI systems and the ethical and technical challenges society faces. Gemma Galdón, algorithm auditor and founder of eticas.ai: how trainable AI systems are and the ethical and technical challenges we face as a society.

Our Founder and CEO Gemma Galdon-Clavell joins the panel "Virtue and the Virtual: A Guide to AI Ethics" at Web Summit 2024 in Lisbon, alongside Roozbeh Aliabadi (CEO and Co-Founder, ReadyAI.org), Xavier Anguera (Co-founder & CTO, ELSA), and tech journalist Esther Paniagua (EL ESPAÑOL). The panel explored how ethical principles can be translated into practical guardrails for AI development, touching on education, societal impact, and the real-world stakes of getting AI ethics right.

Our Founder and CEO Gemma Galdon-Clavell was featured in a Q&A on The Mozilla Blog, discussing an opinion piece she wrote for Context, the Thomson Reuters Foundation's news platform, on AI bias and fairness. Gemma argues that bias is one of AI's most dangerous and least-addressed technical challenges, citing the UK's 2020 A-level grading algorithm — which downgraded state-school students based on historical, inequality-reflecting data — as a warning sign of what happens when biased systems go unchecked.

In the interview, Gemma explains how Eticas's software identifies statistical outliers to ensure they aren't excluded from positive outcomes, and describes the organization's nonprofit arm, which helps communities affected by biased AI systems understand and challenge the algorithms shaping their lives. She also points to the growing practice of AI auditing as a source of optimism, describing her work as building "the seatbelts of AI" — safety measures that could one day make unaudited AI systems as unthinkable as cars without brakes.

Short clip with remarks on complex data systems and the need to bring diverse profiles into AI training.

Closing keynote by Gemma Galdon Clavell at the 5th International Forum on Social Innovation (Jovesólides/Escuela Creactiva, Ciudad Politécnica de la Innovación): ethical dilemmas of AI and the challenges of social innovation for more inclusive societies, at a forum with 300+ attendees addressing issues such as housing, the climate crisis, political polarization, and active aging.

Our Founder and CEO Gemma Galdon-Clavell was named a 2024 Mozilla Rise25 honoree, recognizing entrepreneurs building AI that serves society responsibly. Mozilla's profile describes Gemma as a pioneer in AI safety and auditing, highlighting Eticas.ai's work identifying, measuring, and correcting algorithmic vulnerabilities, bias, and inefficiencies in predictive and LLM tools — including the ITACA platform, the first solution to automate impact analysis and monitoring for AI systems. The honor places her alongside other entrepreneurs building ethical, inclusive AI, including Allen Institute for AI CEO Ali Farhadi and Quill.org founder Peter Gault.

Interview on algorithmic bias auditing, trust in AI systems, the challenges of AI-generated images, and Eticas.AI's product vision; includes reflections on scaling AI startups and building technical teams.

Eticas provided technical support for the Support Pool of Experts Programme at the European Data Protection Board (EDPB), an initiative launched at the request of the Spanish Data Protection Agency (AEPD). The resulting methodology was officially published by the EDPB on June 27, 2024.

As part of this work, Eticas contributed an end-to-end socio-technical algorithmic audit (E2ESAT/AA) methodology — a framework for evaluating AI systems across both their technical performance and their social impact. The deliverables also included a practical AI auditing checklist for regulators and organizations to assess algorithmic accountability, a proposal for "AI leaflets" designed to give end users clear, accessible information about how automated systems affect them, and a proposal for algorithmic scores intended to communicate a system's risk or reliability at a glance.

Together, these tools give data protection authorities and the organizations they oversee a shared, repeatable approach to auditing AI systems for compliance and fairness.

Gemma Galdon Clavell joined Shea Brown (Babl AI's CEO) and Emmanuel Kahembwe on the panel "Covering the Last Mile of Accountability and Oversight: AI Auditing" at IAPP AI Governance Global 2024, moderated by Ashley Casovan (IAPP AI Governance Center).

Gemma Galdon Clavell delivered a keynote on AI and Ethics at the 33rd National Ethics Councils Forum, organized by the Belgian Advisory Committee on Bioethics and the European Commission, alongside Raja Chatila, Antoinette Rouvroy and Rui Nunes.

Our Founder and CEO joined an Oxford-style debate at the Brussels Economic Forum 2024, arguing against the motion "This forum believes that Artificial Intelligence will have a positive impact on the European economy and society," opposite Dame Diane Coyle, Bennett Professor of Public Policy at the University of Cambridge.

Excerpt from the interview with Gemma Galdon (Founder of Eticas.ai), published in full in issue 135 (March 2024) of "Revista Auditores Internos": "We need people capable of understanding an increasingly complex technology and world."