Who is Blueprint Technologies?
We are a technology solutions firm headquartered in Bellevue, Washington, with a strong presence across the United States and an expanding footprint across Latin America (LATAM). Our teams are united by a shared passion for solving complex problems.
At Blueprint, we use technology as a bridge between strategy and execution. Our people bring diverse perspectives, deep expertise, and real-world experience across industries to help organizations grow, transform, and innovate.
About the Role
We are seeking detail-oriented Labelers / Annotators to evaluate responses generated by AI systems across multiple languages.
This role focuses on side-by-side (SBS) evaluation of outputs from different AI models across real-world scenarios. You will play a key role in improving how AI systems understand and communicate across languages and cultures.
This is not a translation role. It is an evaluation and analysis role requiring strong judgment and attention to detail.
Language Requirement
Fluency in English + at least one of the following languages:
Chinese (Simplified and/or Traditional)
Japanese
Korean
Italian
German
French
What You'll Work On
You will evaluate AI responses across scenarios such as:
General-purpose Q& A
Web search results
File-based and image-based responses
Image and file generation tasks
Single-turn and multi-turn conversations
Responsibilities
Perform side-by-side (SBS) comparisons of AI-generated responses
Evaluate outputs based on:
Accuracy
Relevance
Clarity
Instruction-following
Identify nuances in tone, meaning, and cultural context across languages
Apply detailed, scenario-specific annotation guidelines
Maintain consistency and high-quality evaluations
Required Qualifications
Professional fluency in English + at least one target language listed above
Prior experience with side-by-side (SBS) labeling or annotation
Strong analytical thinking and attention to detail
Ability to quickly understand and apply structured evaluation frameworks
Preferred Qualifications
Background in linguistics, translation, or localization
Experience in:
AI evaluation
Data annotation
Search relevance or content quality analysis
Compensation
We offer competitive compensation aligned with local markets and experience.
Estimated hourly range: R$75 – R$85 BRL
Estimated monthly equivalent (full-time): R$12,000 – R$13,600 BRL
Actual compensation will be determined based on experience, skills, and internal equity.
Training & Qualification
All new hires will complete a structured onboarding program, including:
Training sessions and practice exercises
Calibration against quality benchmarks
Qualification review before moving into production work
Benefits & Employment Structure
This role is hired through an Employer of Record (EOR) partner, ensuring full compliance with local labor laws and payroll requirements.
Employees receive locally compliant benefits, which may include:
Statutory benefits (e. G., paid leave, 13th salary where applicable)
Social security and healthcare contributions
Additional benefits aligned with local market practices
Why Blueprint?
Work on cutting-edge AI systems
Be part of a global, multilingual team
Build highly transferable AI evaluation skills
Contribute directly to improving real-world AI experiences
Equal Opportunity Employer
Blueprint Technologies is an equal opportunity employer. We consider all qualified applicants without regard to race, color, age, disability, gender identity, sexual orientation, religion, national origin, or any other protected status.
