AI QA Trainer - LLM Evaluation - Freelance Project job opportunity at Meridial.



bot
Meridial AI QA Trainer - LLM Evaluation - Freelance Project
Experience: General
Pattern: Remote
Walk In
apply Apply Now
Salary:
Status:

Language & Linguistics

Copy Link Report
degreePhD
Hiring inbound within World Wide - Remote

Are you an AI QA expert eager to shape the future of AI? Large-scale language models are evolving from clever chatbots into enterprise-grade platforms. With rigorous evaluation data, tomorrow’s AI can democratize world-class education, keep pace with cutting-edge research, and streamline workflows for teams everywhere. That quality begins with you—we need your expertise to harden model reasoning and reliability. We’re looking for AI QA trainers who live and breathe model evaluation, LLM safety, prompt robustness, data quality assurance, multilingual and domain-specific testing, grounding verification, and compliance/readiness checks. You’ll challenge advanced language models on tasks like hallucination detection, factual consistency, prompt-injection and jailbreak resistance, bias/fairness audits, chain-of-reasoning reliability, tool-use correctness, retrieval-augmentation fidelity, and end-to-end workflow validation—documenting every failure mode so we can raise the bar. On a typical day, you will converse with the model on real-world scenarios and evaluation prompts, verify factual accuracy and logical soundness, design and run test plans and regression suites, build clear rubrics and pass/fail criteria, capture reproducible error traces with root-cause hypotheses, and suggest improvements to prompt engineering, guardrails, and evaluation metrics (e.g., precision/recall, faithfulness, toxicity, and latency SLOs). You’ll also partner on adversarial red-teaming, automation (Python/SQL), and dashboarding to track quality deltas over time. A bachelor’s, master’s, or PhD in computer science, data science, computational linguistics, statistics, or a related field is ideal; shipped QA for ML/AI systems, safety/red-team experience, test automation frameworks (e.g., PyTest), and hands-on work with LLM eval tooling (e.g., OpenAI Evals, RAG evaluators, W&B) signal fit. Skills that stand out include: evaluation rubric design, adversarial testing/red-teaming, regression testing at scale, bias/fairness auditing, grounding verification, prompt and system-prompt engineering, test automation (Python/SQL), and high-signal bug reporting. Clear, metacognitive communication—“showing your work”—is essential. Ready to turn your QA expertise into the quality backbone for tomorrow’s AI? Apply today and start teaching the model that will teach the world. We offer a pay range of $6-to- $65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.Employment type: ContractWorkplace type: RemoteSeniority level: Mid-Senior Level

Other Ai Matches

remote-jobserver Remote
Mathematics Specialist (Fluent in Swedish) - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Finance & Mathematics related tasks
Voice Acting Specialist (English) - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Language & Linguistics related tasks
Video Editing Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Creative & Multi-Media related tasks
Plan Documents Specialist - Freelance Project Applicants are expected to have a solid experience in handling Business & Professions related tasks
remote-jobserver Remote
Oromo Language Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Language & Linguistics related tasks
STEM Specialist (Fluent in Spanish - Spain) - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Sciences related tasks
Telugu Language Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Language & Linguistics related tasks
Bash Coding Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Coding related tasks
Garment Manufacturing QC Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Business & Professions related tasks
remote-jobserver Remote
Full Stack Reinforcement Learning (RL) Engineer Specialist - Freelance Project Applicants are expected to have a solid experience in handling Engineering & Technology related tasks
3D Modeling Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Creative & Multi-Media related tasks
remote-jobserver Remote
Afrikaans Trilingual Language Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Language & Linguistics related tasks
remote-jobserver Remote
Coding Specialist (Fluent in Swedish) - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Coding related tasks
Coding Specialist (Fluent in French) - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Coding related tasks
HR Specialist (Fluent in French) - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Business & Professions related tasks
remote-jobserver Remote
Malayalam Language Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Language & Linguistics related tasks
STEM Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Sciences related tasks
Coding Specialist (Fluent in French) - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Coding related tasks
remote-jobserver Remote
Coding Specialist (Fluent in German) - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Coding related tasks
Ukrainian Language Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Language & Linguistics related tasks
Papiamento Language Specialist - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Language & Linguistics related tasks
LaTex Specialist (Fluent in Spanish- Latin America) - Freelance AI Trainer Project Applicants are expected to have a solid experience in handling Engineering & Technology related tasks
remote-jobserver Remote
Photographer Specialist - Freelance Project Applicants are expected to have a solid experience in handling Creative & Multi-Media related tasks