Quality Auditor & Data Annotator (Freelance)
handigital solutions pvt ltd · May 2026 – Present
- Audit and validate Responsible AI (RAI) content annotation work performed by a team of annotators on the AWS SageMaker Ground Truth platform.
- Ensure strict adherence to the "Multilingual Guardrails RAI Content Annotation" Standard Operating Procedure (SOP), accurately classifying text across 6 harm categories: misconduct, violence, hate, stereotype, insults, and sexual.
- Evaluate annotations based on critical dimensions including intent (harmless/harmful/unspecified) and Intensity (Low/Medium/High) to maintain data integrity for LLM content filtering models.
- Prepare and maintain daily QA reports using Excel, tracking annotator performance, identifying recurring errors, and providing actionable feedback to improve team accuracy and consistency.
- Manage multi-language annotation projects, ensuring high-quality labeled data for training and refining AI models while safeguarding annotator mental health per project guidelines.intensity (low/medium/high)


