Arabic Data Quality Analyst – Remote, $11/hr

About the role

This position focuses on evaluating and improving the quality of personalized AI responses in Arabic. Working remotely, you will design conversational prompts, assess model outputs for relevance and correctness, and ensure proper handling of personal data.

Key responsibilities

• Design multi‑turn conversational prompts that incorporate personal context.
• Evaluate AI responses for relevance, grounding, helpfulness, and correct use of personal data.
• Perform side‑by‑side (SxS) ranking of AI outputs and identify grounding errors or forced personalization.
• Write clear, structured rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain strict data hygiene by deleting evaluation conversations after review.

Required profile

• Fluent in Arabic (reading and writing).
• Experience in data annotation, AI quality evaluation, content moderation, or related analytical roles.
• Strong analytical thinking, attention to detail, and ability to evaluate nuanced AI responses.
• BS/BA degree or equivalent experience in an analytical field.
• Excellent written communication and structured feedback skills.
• Self‑motivated, able to work independently with full‑time availability and a required 4‑hour overlap with PST.

Required skills

• Proficiency with a personal Google account and enabled data sources for debugging.