Senior Python Engineer

About the Role

We are looking for a Senior Python Engineer to help design, build, and scale the foundational backend systems powering AI across our platform. In this role, you will work closely with our CTO and engineering leads to shape key technical decisions around AI architecture, LLM orchestration, model evaluation, and backend scalability.

You will serve as a core technical anchor, developing reliable frameworks and internal services that enable product squads to safely, efficiently, and rapidly deliver LLM-powered features.

This role is ideal for an engineer who thrives on owning complex system challenges, enjoys optimizing production services, and wants to make a substantial technical impact in applied AI engineering.

Work Location: Hanoi or HCMC

Key Responsibilities

• Architect & Scale AI Infrastructure: Design, implement, and maintain robust Python/FastAPI microservices and backend systems that integrate LLMs and generative AI capabilities directly into live workflows.

• Model Evaluation & Quality Frameworks: Build automated pipelines and tooling to continuously measure, evaluate, and improve LLM output accuracy, consistency, latency, and safety.

• Developer Tooling & Frameworks: Develop internal libraries, abstractions, and standardized patterns that empower engineering squads to ship AI features quickly and reliably.

• Production Performance & Cost Optimization: Optimize AI services and inference pipelines for throughput, latency, token economics, caching, and high availability.

• Architectural Leadership: Partner with the CTO and technical leads to evaluate emerging AI technologies, architect retrieval-augmented generation (RAG) pipelines, and design vector search infrastructure.

• Engineering Best Practices: Provide technical mentorship, conduct thorough code reviews, and establish rigorous standards for testing, deployment, and operational observability of AI systems.

Requirements

Required Qualifications

• 5+ years of professional software engineering experience, with a solid background in backend systems, distributed architectures, and API design.

• Advanced Python expertise: Deep understanding of asynchronous programming (asyncio), performance profiling, clean code architecture, and modern backend development.

• Production AI/LLM Integration: Proven hands-on experience integrating LLM APIs (OpenAI, Anthropic, open-source models) or generative AI capabilities into live production environments.

• System Evaluation & Monitoring: Practical experience measuring, evaluating, and improving AI model output quality, latency, and reliability in real-world applications.

• Systems Design & Problem-Solving: Ability to architect decoupled, scalable services with clear boundaries and maintainable data flows.

• Communication & Team Collaboration: Strong communication skills (both English and Vietnamese) and the ability to articulate architectural decisions clearly across engineering teams.

• Strong understanding of information security and technology governance, with experience ensuring engineering practices follow company security policies and ISO 27001-aligned procedures.

Nice to Have

• Hands-on experience with modern Python web frameworks (especially FastAPI).

• Experience with Retrieval-Augmented Generation (RAG), vector databases (e.g., Pinecone, Qdrant, Milvus, pgvector), and embedding pipelines.

• Experience with model fine-tuning, prompt evaluation frameworks, or LLM observability tools (e.g., Langfuse, LangSmith, TruLens).

• Background in building internal developer platforms, tooling, or MLOps/LLMOps infrastructure.

• Experience building scalable B2B SaaS or cloud-native applications.

What We Offer

• Opportunities to work on challenging international software engineering projects.

• Ownership of meaningful technical deliverables and complex engineering challenges.

• A collaborative environment that values engineering excellence, accountability, and knowledge sharing.

• Opportunities to mentor other engineers and contribute to technical best practices.

• Continuous learning and professional development opportunities.

• Long-term career growth within a technology-focused organization.

Candidate Data Privacy Notice

Please note that the personal information provided in your application may be collected, stored, and processed by CoderPush only for recruitment purposes, including reviewing your profile, contacting you during the hiring process, and assessing your suitability for relevant opportunities. If your application is not successful for the current position, we may retain your information for up to 12 months to consider you for future roles that may match your experience. Your data will only be kept for as long as necessary for recruitment purposes or as required by applicable laws and regulations. By submitting your application, you acknowledge that you have read and understood this notice and that the information provided is accurate and complete.