Teachers who know what good group work looks like, and can tell us where scoring, human or AI, gets it wrong.
📍 US-based - Remote
Individual
Employment type — Contract - Independent Expert
As Eticas expands its work on AI in Education in Europe and the US, we are looking to engage independent experts with different levels of expertise to make sure we have everyone at the table and different perspectives to assess our work. Engagements are remote, hourly-based and paid, with an initial defined scope.
Our work is focused on understanding how we can measure AI impacts on learning, and whether we have the tools to measure the right things and support the students who need it. We are also working to build standards so we have homogenized, comparable datasets to understand how learning is changing over time, what works and what doesn't, and for whom.
Working with schools, education authorities and edtech developers, we are testing AI scoring of complex student skills (written reasoning, collaborative problem solving, spoken reasoning) against trained teacher raters, and producing metrics and evidence that show when AI in learning can be trusted, and when it can't.
Our focus is on how AI performs on real student work, judged by real teachers, under real classroom conditions. We get as close as possible to the lived experience of learning and measure it, with the same discipline Eticas has applied for over a decade to AI in hiring, health and public services, among others.
This open call is part of our commitment to openness, inclusion and transparency, so that more voices can join this crucial work.
About the role
Score collaborative problem solving in grades 6 to 8 from transcripts and recordings of small-group work, against a shared rubric, after paid training and calibration with our psychometrician. Every rater scores a common set, so we can see where trained teachers genuinely disagree.
Who we are looking for / Competencies
Current or recent middle school teacher (grades 6 to 8) who regularly runs small-group or project-based work; math and science teachers are especially welcome.
Experience assessing collaboration or group work against criteria is a plus. We are building a deliberately mixed group: different states; urban, suburban and rural schools; district and charter; high-poverty schools; teachers of multilingual learners and of students with IEPs.
Not a fit: tutors or edtech staff without recent classroom experience.
Dedication
Around 12 hours in January: training and calibration the week of January 4, then scoring between January 11 and 15, on your own schedule. Hours are close but not final, and we confirm them before anyone commits.
Compensation
$75 per hour, including training, paid monthly as an independent contractor (W-9).
How to apply
No CV needed: fill in this short form below (about 10 minutes).
Please answer in your own words; short, specific answers work best, as we do not consider generic or AI-written answers.
If you applied to our November round and told us you are interested in January, you don't need to apply again: we will be in touch.
Questions to careers@eticas.ai with "Teacher rater January" in the subject line. Applications close December 14 EOD ET.