Mercor Language Model Evaluator – Fully Remote Part-Time Job
Company: Mercor
Job Title: Language Model Evaluator (English & Urdu)
Job Type: Contract / Part-Time
Work Mode: Fully Remote
Salary: $15–$20 per hour
Location: Worldwide Remote
Education Required: Bachelor’s Degree
Company Logo For: Mercor
Mercor is hiring talented professionals for the position of Language Model Evaluator – English & Urdu. This is a fully remote and flexible opportunity for candidates who have strong English writing skills, are native Urdu speakers, and have experience using AI tools and large language models (LLMs).
Mercor connects elite technical and creative talent with leading AI research labs. The company is headquartered in San Francisco and is backed by world-renowned investors including Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.
Job Responsibilities
- Conduct fact-checking using trusted public sources.
- Evaluate AI-generated responses and identify inaccuracies.
- Assess reasoning quality, tone, clarity, and completeness.
- Generate high-quality human evaluation data.
- Ensure AI responses follow conversational guidelines.
- Work independently and meet project deadlines.
- Help improve the performance of advanced AI language models.
Required Qualifications
Must-Have Skills
- Bachelor’s degree.
- Native Urdu speaker.
- Excellent English writing skills.
- Experience using Large Language Models (LLMs).
- Strong analytical and critical thinking skills.
- Great attention to detail.
Preferred Qualifications
- Experience with RLHF or model evaluation.
- Data annotation or AI training experience.
- Content writing or editing background.
- Ability to compare multiple AI outputs and provide detailed feedback.
Salary and Benefits
- Hourly Pay: $15–$20 per hour.
- Flexible working schedule.
- Work from home opportunity.
- International remote job.
- Part-time contract position.
- Opportunity to work with leading AI research organizations.
Application Process
The complete application process takes around 20–30 minutes.
- Upload your resume.
- Attend an AI interview based on your resume.
- Submit the application form.
Resources and Support
Interview Guide:
Support Email:
support@mercor.com
Mercor reviews applications daily, so candidates are encouraged to complete the AI interview and application steps as soon as possible.
Why Join Mercor?
Mercor offers one of the best remote AI jobs available for English and Urdu speakers. If you are interested in artificial intelligence, content evaluation, data annotation, or AI model training, this opportunity can provide valuable experience while earning competitive hourly pay.
Job Information
| Details | Information |
|---|---|
| Company | Mercor |
| Position | Language Model Evaluator – English & Urdu |
| Job Type | Contract / Part-Time |
| Location | Remote |
| Salary | $15–$20 per Hour |
| Education | Bachelor’s Degree |
| Experience | LLM Experience Preferred |
| Language | English & Urdu |
| Application Time | 20–30 Minutes |
High CPC Keywords for Google AdSense
- Remote AI Jobs
- Work From Home Jobs
- AI Training Jobs
- Data Annotation Jobs
- Artificial Intelligence Jobs
- Online Part-Time Jobs
- Freelance AI Jobs
- High Paying Remote Jobs
- AI Content Evaluation Jobs
- Machine Learning Jobs
- ChatGPT Training Jobs
- Remote Data Analyst Jobs
- Online Jobs for Urdu Speakers
- AI Research Jobs
- Content Writing Jobs
- Flexible Work From Home Jobs
- Remote Contract Jobs
- AI Model Evaluation Jobs
- English Writing Jobs Online
- Remote Freelance Opportunities


