AI Evaluation Specialist/ AI Quality Control Engineer (AI Delivery)

FPT Smart Cloud (FCI) – a member of FPT Corporation, pioneers AI & Cloud solutions in Vietnam. FCI was founded with the mission to generating an immense leap in productivity and agility in business operations.

FPT Smart Cloud aims at leading the industry by focusing on building a firm technological foundation, developing diversified ecosystem products, and reaching global connectivity.

• Customized to specific needs: Providing cloud-based products and solutions customized to each industry.
• All-in-one Platform: Consolidating FPT Smart Cloud technology and diverse business solutions all in one platform. AI & Cloud services are a Unify eco-system.
• Local market leadership: Outstanding Cloud and AI technology infrastructure and platform to help local businesses grow their products and services online.
• Deliver the future: Help customers achieve business outcomes faster by integrating world-class processes and technology.

Key Responsibilities 

AI Quality Evaluation & Validation
• Evaluate AI outputs for accuracy, intent understanding, response quality, consistency, and user experience.

• Perform quality validation for AI Agent solutions before customer delivery and go
live.
• Identify incorrect responses, edge cases, conversation breakdowns, and
hallucinations.
• Validate AI behavior against enterprise business flows, scripts, and acceptance
criteria.
Test Case & Evaluation Scenario Design
• Execute and contribute to AI evaluation frameworks, test cases, and quality checklists.
• Design evaluation scenarios based on real customer use cases and business flows.
• Support regression testing for new releases, prompt changes, and model updates.
• Document test results, defects, and quality risks clearly.
Production Monitoring & Optimization Support
• Monitor AI quality after deployment using logs, reports, and customer feedback.
• Provide structured feedback to AI Builders and PMs for prompt optimization and model improvement.
• Support root-cause analysis for AI quality incidents in production. Cross-functional Collaboration
• Work closely with PMs, BAs, AI Builders and Customer Success teams.
• Support UAT, customer acceptance, and go-live quality validation.
• Act as a quality assurance partner during solution design and delivery phases.

Requirements 

Must-have
• Bachelor degree in Computer Science, IT, Data Science, AI, or related fields.
• Strong analytical thinking and attention to detail.
• Ability to evaluate AI behavior from both technical and business perspectives.
• Good documentation and communication skills.
Nice-to-have
• Experience with Conversational AI and Vision AI.
• Familiarity with AI delivery or customer-facing AI projects.
• Basic knowledge of Python, SQL, or log analysis tools.

Top Benefits

• Salary: Competitive, pay according to ability. Negotiation during the interview.
• Social insurance and health insurance according to labor laws.
• Creative, open-minded working environment that respects individuals
• FPT Premium Care package
• Activities and culture with FCI and FPT Corporation
• Study support package for children of FCI union
• Sponsor related courses and certifications

Working Environment

• Working Location:
  • Site Hanoi: 22rd Floor, Vinacomin Tower, no. 3 Duong Dinh Nghe Street, Cau Giay district, Hanoi.
• Working hours:
  • 8h30 AM – 12h00 PM
  • 1h00 PM – 5h30 PM

• Working days: Monday to Friday (weekends off)

Contact Person

Pham Thi Ha My (Ms.) – Talent Acquisition Team Leader
Email: [email protected]
Phone: 0962456194
FPT Smart Cloud (FCI) Co., LTD
Address: 7th Floor, FPT Tower, No. 10 Pham Van Bach, Cau Giay Dist, Hanoi
Websites: FPT Cloud | FPT AI