About the Role
We are seeking a detail-oriented Labeler / Annotator to evaluate responses generated by AI systems in Chinese (both Simplified and Traditional).
This role focuses on side-by-side (SBS) evaluation of outputs from different AI models across real-world scenarios. You will play a key role in improving how AI systems understand and communicate in Chinese.
This is not a translation role. It is an evaluation and analysis role requiring strong judgment and attention to detail.
What You’ll Work On
- General-purpose Q&A
- Web search results
- File-based and image-based responses
- Image and file generation tasks
- Single-turn and multi-turn conversations
Responsibilities
- Perform side-by-side (SBS) comparisons of AI-generated responses
- Evaluate outputs based on:
- Accuracy
- Relevance
- Clarity
- Instruction-following
- Identify nuances in tone, meaning, and cultural context across Chinese variants
- Apply detailed, scenario-specific annotation guidelines
- Maintain consistency and high-quality evaluations
Required Qualifications
- Native or professional fluency in Chinese (both Simplified and Traditional)
- Strong English reading comprehension (required for guidelines)
- Prior experience with side-by-side (SBS) labeling or annotation
- Excellent analytical thinking and attention to detail
- Ability to quickly understand and apply structured evaluation frameworks
Preferred Qualifications
- Background in linguistics, translation, or localization
- Experience in:
- AI evaluation
- Data annotation
- Search relevance or content quality analysis