ETL/ Data Engineer
Ha NoiĐăng
- Data Engineer
- 3+ YoE
- Ha Noi
Skills bắt buộc
- Python
- Data Pipeline Design
- Data Analysis Tools
- Parquet
- Csv
- Iceberg
- Memory Optimization
- Pipeline Observability
- +8
Mô tả công việc
- Design and build cloud-based data pipelines with scalability and reliability in mind.
- Develop robust modules, functions, and production-ready code for ETL/ELT workflows.
- Perform static & dynamic analysis, execute end-to-end pipeline testing to ensure accuracy and performance.
- Commit to delivery quality and task completion, meeting technical and timeline expectations.
- Create clear documentation covering design, implementation, and testing processes.
Yêu cầu công việc
[Required]
- Bachelor’s degree in information technology, or related fields.
- More than 3 years of experience in python development.
- Experience designing data analytics pipelines.
- Experience in using various data analysis tools.
- Experience storing data in various formats (Parquet, CSV, Iceberg, etc.).
- Memory Optimization Experience.
- Experience in gaining visibility/traceability of data analytics pipelines.
- Experience analyzing data in Python, Spark environments.
- Experience using data analytics services such as Spark.
- Experience in developing cloud (AWS) environments.
- Experience in developing with RDBMS (MySQL) SQL.
- Experience with collaboration tools such as Git, Jira, Confluence, etc.
- Understand and leverage CI/CD. [Preferred]
- Team leading experience.
- Able to communicate in Korean.
Hãy tải CV lên lại để hệ thống có thể chấm điểm. Nguồn: careers Lg Cns Viet Nam