Labeler / Annotator – AI Response Evaluation (Japanese)

Blueprint-Technologies

são paulo, são paulo, Brazil
Full-time
Posted June 04, 2026

Job Description

Labeler / Annotator – AI Response Evaluation (Japanese)

Remote

Who is Blueprint Technologies?

Blueprint Technologies is a technology solutions firm headquartered in Bellevue, Washington, with a strong presence across the United States and an expanding footprint in Latin America. Our teams are united by a shared passion for solving complex problems.

About the Role

We are seeking a detail-oriented Labeler / Annotator to evaluate responses generated by AI systems in Japanese . This role focuses on side-by-side (SBS) evaluation of outputs from different AI models across real-world scenarios. It is an evaluation and analysis role requiring strong judgment and attention to detail – not a translation role.

What You’ll Work On

You will evaluate AI responses across scenarios such as:

  • Web search results
  • File-based and image-based responses
  • Image and file genera...