Labeler / Annotator – AI Response Evaluation (German)

Blueprint-Technologies

são paulo, são paulo, Brazil
Full-time
Posted June 01, 2026

Job Description

Labeler / Annotator – AI Response Evaluation (German)

Remote

About the Role

We are seeking a detail-oriented Labeler / Annotator to evaluate responses generated by AI systems in German .

This role focuses on side-by-side (SBS) evaluation of outputs from different AI models across real-world scenarios. You will play a key role in improving how AI systems understand and communicate in German.

This is not a translation role. It is an evaluation and analysis role requiring strong judgment and attention to detail.

What You’ll Work On

You will evaluate AI responses across scenarios such as:

  • Web search results
  • File-based and image-based responses
  • Image and file generation tasks
  • Single-turn and multi-turn conversations

Responsibilities

  • Perform side-by-side (SBS) comparisons of AI-generated responses
  • Evaluate out...