
Data Engineer - Data & AI
Title: Data Engineer – Data & AI
Rate: $950/day
Start: ASAP
Duration: 6 months
Location: Sydney, WFH hybrid
We are currently seeking a highly skilled Data Engineering Specialist to join a fast-paced data migration project. This role is ideal for someone who thrives on solving complex technical issues and is experienced in defect triage and resolution within large-scale data environments.
Key Responsibilities:
-
Serve as the lead engineer for defect triage and fixing within a high-volume data migration project
-
Analyse, prioritise, and resolve defects across complex data pipelines to ensure performance and reliability
-
Collaborate closely with development, QA, and business stakeholders to troubleshoot issues and drive continuous improvement
-
Optimise PySpark code and ETL processes in an Azure Synapse Analytics environment
-
Use BMC Control-M for job scheduling and monitoring batch processes
-
Apply best practices in data warehousing, SQL, and cloud data architecture
Required Skills & Experience:
-
Advanced proficiency in Data Engineering
-
Extensive experience in Data Migrations
-
Strong expertise with Azure Synapse Analytics
-
Hands-on knowledge of BMC Control-M
-
Advanced capability in building and maintaining Data Pipelines
-
Expert-level proficiency in PySpark
Desirable: Experience in the banking industry or other highly regulated sectors.
If you’re a detail-oriented data engineer ready to jump into a dynamic project environment, we’d love to hear from you. Apply today to start ASAP!