Job Description

Salary: $90,000 - 130,000 per year Requirements:

• ###
• We are seeking candidates with a PhD or Masters Degree in a relevant field, and current enrollment is acceptable. You should possess deep expertise in your subject area, with the ability to create intricate, graduate-level problems that challenge AI reasoning. Strong analytical and problem-solving skills are essential, along with experience in formulating rigorous, high-quality questions and solutions. Attention to detail is crucial for accurately assessing AI capabilities and evaluating peer submissions. Fluency or high proficiency in English is a must.
• ###

• In this role, you will be responsible for developing challenging prompts that the AI model struggles to answer correctly. You will create a grading rubric that outlines what constitutes a good response and write the perfect answer that achieves a score of 100% on this rubric. Additionally, you will provide clear and constructive feedback to enhance AI-generated responses.
• ###

• AI

More:

At Outlier AI, part of Scale AI, we are committed to the belief that AI performance is solely as good as the data it’s trained on. To improve our AI models, we collaborate with contributors around the globe who provide valuable human feedback. Our platform is designed for remote work, enabling freelance contributors to showcase their specialized skills while we focus on ensuring they have a positive experience, guided by our core principles of reliability, transparency, and flexibility.

last updated 48 week of 2025

Job Tags

Similar Jobs