What You’ll Do
Evaluate AI model outputs and provide structured, high-quality feedback
Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
Contribute to improving evaluation frameworks, not just executing them
Identify trends in model performance and communicate insights clearly
Participate in team discussions, calibrations, and stakeholder syncs
Partner with leads and cross-functional teams to refine quality standards
Document findings in a clear, concise, and actionable way
What We’re Looking For
Native-level Portuguese (Portugal) language proficiency and a university degree (Bachelor’s or higher).
B2 or superior level of English.
1–2 years of professional writing experience with strong, structured writing skills
Ability to apply complex writing rules and guidelines consistently
Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
Strong critical thinking and attention to detail
Ability to make sound judgment calls in ambiguous situations
Naturally curious about AI, technology, and how systems behave
Comfortable speaking up, asking questions, and contributing ideas
Strong written and verbal communication skills
Ability to stay consistent while working with evolving guidelines
Experience in data quality, QA, annotation, or analysis is helpful — but not required
Benefits
Paid Vacation: 6 days
Paid Company Holidays: 2 days (Memorial Day and Labor Day)
Paid Sick Leave: accrued per applicable state law and company policy
Medical, Dental, and Vision Insurance (eligibility applies)
Health Savings Account (HSA)
401(k) Retirement Plan
Employee Assistance Program
Additional voluntary benefits (life, accident, critical illness, etc.)
Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
Unique Campus Features: Some locations include roof-top nature parks
Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.
Source: local_ats. Description and metadata as published by the employer or its applicant tracking system on 2026-10-31. The apply link goes to the original source. Paige JobBank does not accept applications on the employer's behalf.
PAIGE