Thiết kế, xây dựng giải pháp phần mềm kiểm thử và đánh giá AI bằng LLM cho khách hàng quốc tế.
Yêu cầu
5+ năm kinh nghiệm phát triển phần mềm, làm backend, REST/gRPC API hoặc dev tools
Thành thạo Python và ít nhất một ngôn ngữ Java, JavaScript/TypeScript hoặc C#
Kinh nghiệm tích hợp LLM API (OpenAI, Anthropic, Bedrock) và dùng LangChain/LlamaIndex
Hiểu biết về RAG, prompt engineering, agentic patterns và kiến thức testing
Giao tiếp tiếng Anh lưu loát
Trách nhiệm
Thiết kế và xây dựng giải pháp phần mềm end-to-end cho kiểm thử và đánh giá AI
Phát triển ứng dụng AI bằng framework LLM orchestration như LangChain, LlamaIndex
Xây dựng nền tảng AI Evaluation Service gồm pipeline, scoring engine, dashboard và benchmark
Tích hợp RAG, agentic workflow, prompt engineering, fine-tuning vào nền tảng QA
Có thì tốt
Giao tiếp tiếng Nhật tốt
Kinh nghiệm vector DB (Milvus, Pinecone) và framework đánh giá AI (Ragas, DeepEval)
Kinh nghiệm Cloud AI (AWS Bedrock, Azure OpenAI) hoặc agent frameworks (CrewAI, LangGraph)
Lương và phúc lợi
Thưởng 1 tháng lương ký hợp đồng sau thử việc
Giảm 20% học phí tại FPT School cho con cái
Cấp tài khoản Udemy
Hỗ trợ giấy phép lao động, bảo hiểm và tái định cư cho người nước ngoài
Tóm tắt bằng AI từ JD gốc, đọc JD gốc trước khi ứng tuyển.
WORK LOCATION: Ho Chi Minh, Ha Noi, Da Nang
ABOUT FPT SOFTWARE
FPT Software, a subsidiary of FPT Group, is a leading global IT service provider headquartered in Vietnam. With 33,000+ employees in 88 offices across 30 countries, we serve 1,100+ clients, including 96 Fortune 500 companies.
We believe diversity fuels innovation and strive to create an inclusive workplace where talents of all backgrounds thrive. We welcome expatriates and international professionals to bring fresh perspectives and help shape the future of technology.
RESPONSIBILITIES
Design and build end-to-end software solutions for testing and AI evaluation — automation frameworks, evaluation pipelines, test data generators, and AI-powered productivity tools used across client delivery projects.
Develop AI-driven applications using LLM orchestration frameworks (LangChain, LlamaIndex, or similar) that automate test case generation, log analysis, defect triage, and result validation.
Build the technical foundation of our AI Evaluation Service — pipelines, scoring engines, dashboards, and benchmarking tools that validate LLM-powered applications for global clients.
Integrate modern AI capabilities — RAG, agentic workflows, prompt engineering, fine-tuning — into internal QA platforms and client-facing solutions.
Analyze current manual testing, automation, and Business Analysis (BA) workflows; design and deliver software solutions that remove bottlenecks through AI.
Collaborate with QA leads, AI engineers, and clients to translate requirements into well-architected, shippable software.
Continuously research emerging AI tools and frameworks, prototype rapidly, and productionize the ones that prove valuable.
Champion engineering best practices — CI/CD, code review, system design, observability — and mentor junior engineers on the team.
REQUIREMENTS
Bachelor’s or Master’s degree in Computer Science, Software Engineering, Mathematics, or a related technical field.
5+ years of professional software development experience, with a track record of shipping production-grade applications or platforms.
Strong programming skills in Python (preferred for AI work) and at least one of Java, JavaScript/TypeScript, or C#.
Solid software engineering fundamentals: design patterns, system design, API design, CI/CD, automated testing, and code review.
Hands-on experience building backend services, REST/gRPC APIs, developer tools, or internal platforms.
Practical experience using AI coding assistants (ChatGPT, Claude, GitHub Copilot, Cursor) and shipping code that integrates LLM APIs (OpenAI, Anthropic, Azure OpenAI, AWS Bedrock).
Working knowledge of LLM concepts — prompts, context windows, RAG, embeddings, agentic patterns.
Exposure to at least one LLM orchestration framework — LangChain, LlamaIndex, Haystack, or similar.
Familiarity with software testing concepts — test pyramid, test automation, evaluation methodologies — sufficient to build the right tools for QA teams. You do not need to be a tester, but you must understand what QA needs.
Fluent in English, with the ability to communicate technical designs clearly to both engineers and non-technical stakeholders. Japanese communication skills are a strong advantage.
Nice to have
Prior experience building developer tools, test automation frameworks, evaluation platforms, or AI-powered productivity products.
Experience with vector databases (Milvus, Pinecone, Chroma, Weaviate) and embedding models.
Exposure to AI evaluation frameworks (DeepEval, Ragas, G-Eval, OpenAI Evals) and an understanding of how to measure LLM faithfulness, relevancy, and toxicity.
Cloud AI services experience (AWS Bedrock, Azure OpenAI, GCP Vertex AI) including deployment, monitoring, and CI/CD for AI workflows.
Experience with workflow orchestration (Airflow, Prefect, Temporal) or agent frameworks (LangGraph, AutoGen, CrewAI).
Open-source contributions, technical blog writing, or conference talks.
Certifications: Cloud AI (AWS Certified AI Practitioner, Azure AI Engineer AI-102, Google Professional ML Engineer), AI Governance (IAPP AIGP, ISO/IEC 42001), or AI Testing (ISTQB AI Testing).
WHAT COMPANY OFFERS
Be part of our hugely international environment; we are currently working with the customer, where you can have many opportunities to work oversea.
Competitive salary package based on skills and experience.
Work Permit, Health Insurance, and Relocation Assistance provided for expats.
One-month salary signing bonus after probation
20% discount on school fees if your sons/ daughters join FPT School
Udemy accounts for every Fsofters
Opportunity to work in international environments
We create great teams and take very good care of them;
Great opportunity to grow with the company;
Frequent staff activities and company parties;
Awesome social events and parties for employees;
Wear what you want, be your unique self at work;
Other benefits following the Labor Laws…
CONTACT Department: North Talent Acquisition – FPT Software Workforce Assurance – FPT Software Ha Noi Company Limited Email: [email protected] Website: www.career.fpt-software.com