# Data Scientist - AI Evaluation at Mercor in Mumbai, India…

> Source: https://confidential.careers/job-detail/data-scientist-ai-evaluation-mercor-mumbai

# Data Scientist - AI Evaluation

Mercor 

** Mumbai, India ** Full Time ** Data & Analytics Jobs ** India ** Posted 4d ago

[Apply Now](https://confidential.careers/go/13243181) ** Save 

## Job Description

**About the job**

**Mercor** connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include **Benchmark**, **General Catalyst**, **Peter Thiel**, **Adam D'Angelo**, **Larry Summers**, and **Jack Dorsey**.

**Position:** Data Scientist Talent Network
**Type:** **Contract**
**Compensation:** **$100–$150/hour**
**Location:** **Remote**

**Role Responsibilities**

- Design precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, and A/B test write-ups. 
- Evaluate AI-generated or human-created work against established criteria to ensure quality and consistency. 
- Provide detailed written justifications for evaluations and scores to maintain transparency and accountability. 
- Apply consistent, evidence-based judgment to ensure assessments are reproducible and defensible. 
- Incorporate structured feedback from senior reviewers and iterate on submitted work for continuous improvement. 
- Work independently and asynchronously to meet deadlines and improve AI model performance. 

**Qualifications**

**Must-Have**

- 1+ years of professional data science experience. 
- Experience at a leading technology, research, or quantitative firm. 
- Strong command of Python, SQL, statistical modeling, machine learning, and experimentation. 
- Exceptional written communication skills. 
- Detail-oriented and consistent approach to evaluating complex work. 
- Comfort receiving feedback and calibrating judgment against established standards. 

**Application Process (Takes 20–30 mins to complete)**

- Upload resume 
- AI interview based on your resume 
- Submit form 

**Resources & Support**

- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome 
- For any help or support, reach out to: support@mercor.com 

*PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.*

Posted August 9, 2026