CW | Senior Data Engineer

About Our Partner

Our partner is Australia’s only dedicated B2B credit reporting agency, and one of the country’s most innovative fintech success stories.

We help Australian businesses of all sizes - from sole traders and family-run operators to ASX listed enterprises - reduce risk, get paid faster and trade with confidence. Our platform helps businesses see financial trouble coming early enough to do something about it. By predicting failure before it happens, we empower our customers to protect revenue, safeguard cash flow and grow with confidence.

We offer a complete suite of credit reporting and risk management solutions across the entire customer lifecycle - from onboarding and automated credit decisioning through to ongoing monitoring, PPSR registrations, UBO/KYC reporting and automated collections.

Trusted by thousands of businesses across every industry and region in Australia, CreditorWatch sits at the centre of the country’s B2B economy, providing the data, insights and technology that keep trade moving.

Our Purpose:
Empower Australian businesses to trade confidently with their customers.

Our Mission:
We aim to be number one in our industry by delivering unique data insights and innovative products.

Position Overview:
The Senior Data Engineer plays a key role in designing and delivering scalable, high-performance data solutions. This role takes ownership of complex technical components like data pipelines, data and machine learning models, mentors junior engineers, and partners closely with stakeholders to ensure data platforms support product and business needs.

Some of your responsibilities include and are not limited to:

• Design, build and operate data products that serve the CreditorWatch/Collect applications, and internal analytics teams
• Own data solutions end to end - source integration through to the interface apps and analytics consumers
• Contribute to the data platform on Databricks - Lakeflow pipelines, Unity Catalog governance, Databricks apps with Lakebase backend
• Build and extend transformation layers in dbt core, with testability and clear ownership
• Use Claude Code or similar Agentic AI coding tools and Databricks Agent Skills as a core part of the development workflow with accountability for quality
• Partner with product, analytics and software engineering teams on how data products are consumed by the broader CW stack
• Mentor DEs via code reviews, pairing and technical guidance
• Contribute to architectural decisions, platform standards and continuous improvement

Competencies (essential behaviours required for the role):

• Strong expertise in SQL and Python, with track record of delivering production-grade data solutions
• Experience with modern data platforms and tools such as Databricks, dbt and cloud data warehouses
• Strong understanding of data modelling and storage patterns for analytical and operational use cases
• Experience working with cloud platforms, ideally AWS
• Understanding of data security, governance and access control principles
• Experience serving data into customer-facing applications, not only analytics / reporting layers
• Comfort working with AI-assisted development tools (e.g. Claude Code, Databricks Agent Skills) as day-to-day workflow
• Clear written and verbal communication, especially when working across time zones with teams in Australia
• Good English communication skills (both verbal & written), especially in the global software development environment.

Due to the large number of applicants, only shortlisted candidates will be contacted.

#LI-MT1