Lãnh đạo đội ngũ kỹ sư nền tảng dữ liệu, quản trị và phát triển hạ tầng phục vụ dữ liệu và AI/ML.
Yêu cầu
Từ 5 năm kinh nghiệm trong môi trường phát triển phần mềm
Kinh nghiệm lãnh đạo đội ngũ kỹ sư data platform hoặc AI/ML platform
Kiến thức sâu về Airflow, Kafka, Spark, Trino, MLFlow, Kubernetes, Terraform
Tốt nghiệp đại học chuyên ngành Khoa học máy tính, Kỹ thuật hoặc liên quan
Tiếng Anh lưu loát
Trách nhiệm
Dẫn dắt và phát triển đội ngũ kỹ sư nền tảng dữ liệu theo hướng tự tổ chức
Cài đặt, cấu hình, giám sát và bảo trì các nền tảng dữ liệu, xử lý sự cố
Đảm bảo thiết kế nền tảng hỗ trợ huấn luyện và phục vụ AI/ML, quản lý và chất lượng dữ liệu
Đảm bảo dự án giao đúng hạn, đúng phạm vi và xử lý rủi ro phát sinh
Có thì tốt
Kinh nghiệm làm việc trong môi trường có sự phụ thuộc đa nhóm (cross-team)
Tóm tắt bằng AI từ JD gốc, đọc JD gốc trước khi ứng tuyển.
JOB DESCRIPTION
Team Leadership and Management:
Lead and mentor agile team of data platform and support engineers towards self-organization and empowerment
Conduct performance reviews and provide professional development opportunities
Present team achievements in internal and external events
Data Platform Administration & Support:
Install, configure, maintain and monitor data platforms, including databases, filesystems, and other related technologies
Regularly update and patch systems to maintain security and stability
Identify, diagnose, and resolve data platform problems in a timely manner
Implement and maintain backup and recovery strategies for data platforms, ensuring data integrity and availability
Inform, support and educate users of historical and new platform features and related processes
Continuous Improvement, Technical Excellence and Accountability:
Ensure proper data platform design and platform features enabling AI/ML model training/serving, data management, data quality tracking
Oversee the technical design aligned with company strategy and policies
Follow, select and apply the latest technologies and best practices in platform code, management, and AI/ML area
Delivery Tracking:
Ensure projects are delivered on time, within scope, in alignment with product owner and users’ expectations, including non-functional requirements (performance, security, stability, observability, continuity)
Manage expectations, risks and resolve issues that arise during platform lifecycle
Collaboration with Product Owner(s) and Development Team(s):
Work closely with the Product Owners and Development Teams depending on platform features and performance to align platform roadmaps with their goals
Provide platform-level feasibility assessments for new features and enhancements
Ensure clear communication and coordination between the team, Product Owner(s) and Development Team(s)
Automation, code quality and documentation:
Implement and maintain quality standards for platform code
Ensure regular testing and validation are implemented as vital part of automated CI/CD
Data Governance and Compliance:
Ensure data platform features comply with relevant data privacy and security regulations and policies
Manage data access and usage to protect personal data and other sensitive information
KEY REQUIREMENTS
Previous experience with leading data or AI/ML platform engineering team
Good knowledge of leading data platforms (Apache Airflow, Kafka, KServe, Iceberg, Lakekeeper, MLFlow, OpenMetadata, Oracle RDBMS, Spark, Trino), their operations and related infrastructure installation, administration, monitoring (Grafana, Prometheus), patching and automation (Linux, GIT, Ansible, Helm, Terraform, Kubernetes, Ceph, KVM)
Good level of understanding of typical data consumer use cases including applications, model training, model serving and various visualization tools (PowerBI, Grafana).
Able to define team processes and track work item queues using JIRA software
Able to provide well-structured, engaging feature and guideline documentation
Experience tracking team member performance, identifying growth opportunities, ensuring smooth collaboration
Bachelor’s degree in computer science, engineering or related field
Fluent English
5+ years in a software development environment preferably involving cross-team dependencies.