
Safety Prompt Engineer and RLHF Expert
Mercor · Jul 2026 – Aug 2026
- Evaluated AI-generated responses for accuracy, relevance, reasoning quality, instruction-following, and overall response quality.
- Created and refined prompts for LLMs to test reasoning, problem-solving, factual accuracy, and adherence to task requirements.
- Reviewed and annotated text, image, and multimodal AI outputs using detailed evaluation guidelines and scoring rubrics.
- Identified hallucinations, logical errors, inconsistencies, and unsupported claims, providing clear feedback to improve model performance.
- Performed quality assurance and comparative evaluation of model responses to ensure consistency, accuracy, and alignment with project requirements.
- Applied prompt engineering techniques including few-shot prompting, structured instructions, and prompt chaining for Al evaluation and training tasks.
- Collaborated with project teams to maintain annotation standards, resolve edge cases, and deliver high-quality AI training data.




