About the Role
We are seeking a Language Model Evaluator - Part-time Contract - Remote to join our team. In this role, you will work with leading AI research labs to enhance language models and improve their performance. This position allows you to leverage your linguistic skills while working independently from anywhere in the UAE.
Responsibilities
- Conduct thorough fact-checking using reliable public sources and external tools.
- Generate high-quality human evaluation data by identifying strengths, areas for improvement, and factual inaccuracies in model responses.
- Assess the quality of reasoning, clarity, tone, and completeness of AI-generated responses.
- Ensure that model outputs align with expected conversational behavior and established guidelines.
- Work independently and asynchronously to meet deadlines while contributing to AI model enhancements.
Requirements
- Bachelor's degree in a relevant field.
- Native proficiency in Urdu.
- Significant experience using large language models (LLMs).
- Excellent writing skills in English.
- Strong attention to detail and analytical thinking.
- Background or experience in structured analytical domains.
- Preferred: Experience with Reinforcement Learning from Human Feedback (RLHF), model evaluation, or data annotation.
- Preferred: Previous experience in writing or editing high-quality written content.
Benefits
As a contractor, you will enjoy flexible working hours and the opportunity to work remotely. This position offers competitive compensation ranging from AED 55 to AED 73 per hour, depending on your experience and skills. Visa sponsorship is not provided; candidates must have valid UAE residency.
For more opportunities, explore remote opportunities in the UAE or other jobs in Dubai. Our team reviews applications daily, so complete your AI interview and application steps to be considered.