Data Engineer

About the role

An exciting opportunity is available for an experienced Data Engineer to join a large-scale, enterprise data transformation program within a Queensland Government organisation. This multi-year initiative is establishing a centralised Enterprise Data Platform that will transform how data is managed, governed and leveraged across the organisation.

This role offers the opportunity to work on a high-profile program that will shape the future of enterprise analytics and reporting while utilising the latest Microsoft data technologies.

Key responsibilities

• Design, develop and maintain secure and scalable data pipelines using Microsoft Fabric, Azure and related technologies.
• Build and manage ingestion and transformation processes across Bronze, Silver and Gold data layers using medallion architecture principles.
• Develop curated datasets, semantic models and reusable data products to support Power BI reporting and enterprise analytics.
• Configure and manage Microsoft Purview scans, metadata, classifications, sensitivity labels and data lineage.
• Implement automated data quality validation, testing and technical documentation.
• Apply security, privacy-by-design and governance principles, including RBAC, managed identities and data masking.
• Develop and maintain CI/CD pipelines using Azure DevOps and Git-based workflows.
• Monitor platform performance, optimise storage and compute utilisation, and support operational reliability.
• Collaborate with data stewards, analysts, product owners and technical teams to deliver prioritised outcomes.
• Contribute to engineering standards, reusable templates, best practices and continuous improvement initiatives.

Highly desirable criteria

• Demonstrated experience with Microsoft Fabric, including Pipelines, Dataflows Gen2, Notebooks, Lakehouse, OneLake and SQL Endpoints.
• Strong SQL and PySpark development experience.
• Hands-on experience with Microsoft Purview, including metadata scanning, lineage, governance and sensitivity classifications.
• Proven experience designing and implementing enterprise data platforms using medallion architecture.
• Experience developing semantic models and delivering data products for Power BI.

Desirable criteria

• Experience with Azure Data Factory, Azure Synapse Analytics or Azure Databricks.
• Experience implementing CI/CD pipelines using Azure DevOps.
• Exposure to Infrastructure as Code using Bicep or Terraform.
• Experience working within enterprise data governance frameworks.
• Previous experience delivering large-scale data transformation or cloud migration programs within complex environments.

Skills and experience

• Minimum five years' experience as a Data Engineer or in a similar enterprise data engineering role.
• Strong understanding of Microsoft Azure data services and modern cloud-based data platforms.
• Experience building production-grade ETL/ELT pipelines and curated datasets.
• Strong understanding of data governance, security, privacy and data quality principles.
• Excellent analytical and problem-solving skills with strong attention to detail.
• Ability to communicate effectively with both technical and non-technical stakeholders.
• Experience working in Agile delivery environments and collaborating within cross-functional teams.

Benefits

• Opportunity to work on a significant, enterprise-wide data transformation program.
• Exposure to modern Microsoft Fabric and Azure technologies.
• Hybrid working arrangements available upon request.
• Supportive, collaborative and high-performing team environment.
• Long-term contract opportunity with a large Queensland Government organisation.
• Standard full-time hours (38 hours per week) with flexible working arrangements available.

Contact details

For a confidential chat, please contact Raisa on 0437 318 208 or via email at Sign in to view email and we would be more than happy to provide you with additional information and assist in the application process.

Please note that a National Police Check might be required as part of pre-employment screening.