QA Specialist: If you are looking for a flexible remote job in the AI and technology sector, the Project Athena QA Specialist (GenAI/LLM) role is an excellent opportunity for skilled English professionals in India. This position is designed for individuals interested in working with cutting-edge Generative AI and Large Language Model (LLM) systems while earning competitive hourly compensation.
This remote opportunity offers $8 per hour, making it a competitive option for professionals seeking part-time income. With a minimum commitment of 10–15 hours per week, it is suitable for freelancers, students, working professionals, and tech enthusiasts in India who want flexible working hours.
Overview (QA Specialist)
| Project Name | Athena |
| Job Title | QA Specialist (GenAI/LLM) |
| Language Requirement | English (India) |
| Compensation | $8 per hour |
| Availability Required | Minimum 10–15 hours per week |
| Work Type | Remote / Contract-Based |
Role Description (QA Specialist)
As QA at Centific specializing in Generative AI Data Services, you will play a pivotal role in driving the success of our cutting-edge projects focused on building and enhancing Large Language Models (LLMs). Your primary responsibility will be to adhere to quality review instructions, pass, review or reject human-labeled data crucial for training AI models. In this dynamic and evolving field, you will be at the forefront of bridging the gap between human expertise and artificial intelligence, contributing significantly to the development of next-generation AI technologies. As a problem solver and highly organized lead, you will collaborate closely with internal teams and a global workforce, ensuring seamless communication, efficient execution, and successful delivery of projects.
Task Overview (QA Specialist)
As an API Response Reviewer, you will evaluate AI-generated answers to seller questions by checking the underlying API calls used to produce those responses. Your job is to ensure the correct API function was called, the input parameters match the seller’s intent, and the output is accurate and relevant.
Key Responsibilities:
- Review seller questions to confirm they match the intended purpose of the selected API input parameter
- Validate that the AI-generated answer is appropriate for the chosen API function.
- Check if the API output includes all necessary information to fully answer the seller’s query.
- Identify and assess individual data points in the AI response for accuracy and relevance.
- Label data points such as SKUs, statuses, quantities, dates, and identifiers in the response.
- Use API documentation to answer structured review questions.
- Provide comments and feedback to clarify decisions or flag inconsistencies.
Language Proficiency:
- Native level fluency in English (India).
- Strong written and verbal communication skills in English.
Skills and Responsibilities
- Assisting in the development and implementation of quality assurance policies.
- Collaboration on project guidelines and supplemental learning materials.
- Investigate issues and complete weekly error trend and quality reports as assigned.
- Assist in development and application of golden tests or other quizzes.
- Ensure compliance with client-specific requirements and performance standards in quality aspects of project execution.
- Provide feedback and recommendations to PM team regarding UI design.
- Review annotators and arbitrators weekly via the production monitoring process.
- Review metrics and spot check individual tasks.
- Assign a weekly project status.
- Identify errors and provide any specific feedback on labeling approach.
- Ensure egregious contributors are removed promptly.
- Ensure arbitrators understand how to select Ground Truth.
- Record and flag quality issues.
- Create FAQs and weekly quality newsletter.
- Project Processes
- Utilize Jira to track and execute tasks.
- Participate in the planning processes to decrease defects in data workflows.
- Identify and solve quality issues.
- Collaborate with PM team to optimize project workflows and streamline processes.
- Conduct end-of-day reporting to ensure smooth project handoffs and continuity across shifts.
Key Qualifications:
- Required: Diploma and at least 2-3 years of experience in quality management, particularly in data services for AI.
- Desired: Bachelor’s degree, Linguistics or other related field of study
- Experience writing data-labeling project guidelines and materials (or similar work in another field).
- Experience analyzing quality metrics and conducting root cause analysis via deep dives and trend patterns.
- Ability to create useful and impactful insights for annotators and clients.
- Basic familiarity with Microsoft Office 365 including Outlook, Excel, and PowerPoint.
- General knowledge of online communication and ability to work remotely.
- Excellent communication both written and spoken.
- Collaborative and solution focused.
- Confidence and the ability to give/take feedback.
- Ability to follow project directions and perform time bound tasks accurately and efficiently.
- Ability to maintain quality while performing repetitive tasks.
- Detail-oriented and problem-solving mindset.
- Organized and focused enough to work independently as a role player within a team environment.
Availability:
- Minimum of 10-15 hours per week.
- The project is scheduled to continue through March 31, 2026 with potential for future opportunity
- Willingness to participate in training sessions and demos.
Compensation
Compensation $8 per hour USD
| Apply Link | Click here |
| Official Website | Click here |
| English Audio Collection Projects | Click here |