Data Engineer

Kaizen Global Technologies

Date: 1 week ago
City: Sydney, New South Wales
Est. A$138,846 - A$163,608 / yr ⓘ
Contract type: Full time

Location: Sydney, Australia

Employment Type: Permanent

Experience: 8+ Years

Key Responsibilities

  • Design, develop and maintain scalable ETL/ELT data pipelines.
  • Build and support data solutions using AWS S3, Glue, EMR, Athena and Aurora PostgreSQL.
  • Develop data processing and transformation solutions using Python, SQL, Spark and PySpark.
  • Design and maintain effective data models for analytical and operational requirements.
  • Implement and support Change Data Capture (CDC) and data integration processes.
  • Ensure data quality, governance, security and reliability across data platforms.
  • Troubleshoot production issues and optimise data pipelines for performance and scalability.
  • Implement automated deployments and testing through CI/CD pipelines and GitHub Actions.
  • Collaborate with engineering, architecture, product and business stakeholders in an Agile environment.

Key Skills

  • Strong hands-on experience with SQL and Python.
  • Strong AWS experience, particularly S3, Glue, EMR, Athena and Aurora PostgreSQL.
  • Strong experience with Spark/PySpark.
  • Experience developing ETL/ELT pipelines and data integration solutions.
  • Strong understanding of data modelling and operational databases.
  • Experience with CDC, data governance, monitoring and CI/CD.
  • Good problem-solving, communication and stakeholder management skills.

Desirable Skills

  • Kafka / Amazon MSK
  • Terraform / Infrastructure as Code
  • Event-driven architectures
  • Snowflake
  • DBT

Please drop your cv to

For employers only

Is this your company's job post? Verify ownership to manage this listing and receive applications directly.

Claim this listing

Looking to apply for this job? Use the Apply button above.

See more jobs in Sydney, New South Wales