This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.
Apply Now
Role Description
Mercor is looking for experienced evaluators to support a critical evaluation workflow in partnership with a leading AI research lab. This project focuses on improving model performance in the Enterprise IT & Cloud domain by evaluating agent-generated research reports that delve into the latest trends, technologies, and strategies in IT infrastructure, cloud computing, and enterprise solutions.
Qualifications
- Strong backgrounds in Enterprise IT , Cloud Computing , or IT infrastructure
- Experience or knowledge in cloud technologies, IT services, or enterprise software solutions
- Understanding of current trends in IT and cloud computing, including emerging technologies like artificial intelligence and machine learning
- Ability to critically assess the quality and accuracy of technical research
- Comfort providing feedback on complex technical subjects
Requirements
- Evaluate the quality and relevance of agent-generated research reports on Enterprise IT & Cloud topics
- Provide structured feedback using a provided rubric and explain your evaluation through written justifications
- Work asynchronously and independently, ensuring evaluations are completed within the designated timeframe
- Maintain a high level of accuracy and consistency throughout the evaluation process
Benefits
- Part-time (20–40 hours/week) with flexible scheduling
- 100% remote and asynchronous — work from anywhere
- Contractor position via Mercor, paid hourly
- Competitive rates: $20–$30/hour depending on expertise
- Weekly payments processed securely through Stripe Connect
Apply Now