Data Engineer (Databricks, SQL, Python)

Mô tả công việc

About the Role

We are seeking skilled and motivated Data Engineers to join our growing data platform team. In this role, you will design, develop, and maintain modern data architectures and end-to-end data pipelines using Databricks, Python, and SQL, powering analytics, reporting, and data-driven decision-making across the organization.

Core Responsibilities by Level

Senior Data Engineer

• Architect and design scalable, fault-tolerant data pipelines and robust data platform components on Databricks.
• Own end-to-end data modeling (fact/dimension tables, data marts) aligned with business domain needs.
• Conduct code reviews, establish engineering standards, and mentor Junior and Middle engineers.
• Collaborate closely with stakeholders, translate business needs into technical specifications in English, and drive data governance and reliability initiatives.

Middle Data Engineer

• Independently build, optimize, and maintain batch and data marts on Databricks.
• Implement dimensional models, facts, dimensions, and aggregation layers.
• Write clean, maintainable, and modular Python and SQL code under version control (Git).
• Interpret technical requirements, draft pipeline documentation, and review junior peers' code.

Yêu cầu công việc

Qualifications and Education Requirements:
Must have:
- Programming & Querying: Strong proficiency in SQL (complex joins, CTEs, window functions, query optimization) and Python (data manipulation libraries, OOP concepts).
- Data Modeling: Solid understanding of dimensional data modeling (Kimball methodology, star/snowflake schemas, fact and dimension tables, data marts).
- Version Control: Hands-on experience working in a team environment using Git (branching, PR reviews, merge strategies).
- Communication: Ability to read, understand, and write clear technical specifications, user stories, and documentation in English.
 

By level
- Senior: 2+ years of hands-on Databricks experience (must). Can design the data platform and review code.
- Middle: 1.5+ years of hands-on Databricks experience. Can build pipelines and data marts on their own.

Nice to Have:
- Practical experience with the modern Databricks ecosystem: Delta Lake, Databricks Workflows / Jobs, and Unity Catalog.
- Experience in streaming pipelines
- Experience working with or migrating workloads to/from Snowflake.
- Hands-on experience with dbt (data build tool), Terraform (IaC), and automated CI/CD pipelines.
-Working knowledge of cloud ecosystems (AWS or Azure services like S3/ADLS Gen2, IAM, Lambda/Azure Functions).

Professional certifications:
-Databricks Certified Data Engineer (Associate / Professional)
-Snowflake SnowPro Core / Advanced