Data Engineer-GCP

XPT Software

Date: 5 days ago

City: Sydney, New South Wales

Est. A$129,638 - A$149,579 / yr ⓘ

Contract type: Full time

Job Details

Must Have Skills

Strong GCP Data Services Expertise - Hands-on experience with BigQuery, Dataflow, Pub/Sub, Cloud Storage, Ability to design scalable data solutions using native GCP tools.

Experience in Data Pipeline Development (Batch & Streaming) - Building and maintaining ETL/ELT pipelines, Experience with real-time streaming and batch processing.

Strong Programming & Query Skills - Proficiency in Python and SQL, Experience with data processing frameworks like Apache Beam or Spark

Understanding of Data Modeling & Warehousing - Strong understanding of data modeling (star/snowflake schemas), Experience designing and optimizing data warehouses (BigQuery)

Nice to Have Skills

Experience in Multi-Cloud Exposure : Understanding of cross-cloud data integration and migration, Experience working with

AWS or Azure alongside GCP

Knowledge of Streaming & Messaging Frameworks : Experience with Kafka or advanced Pub/Sub patterns, Knowledge of real-time data architectures

Basic Understanding of Containerization & Orchestration : Hands-on with Docker and Kubernetes (GKE), Ability to deploy and manage data workloads in containerized environments

Data Governance & Security : Familiarity with data lineage, cataloging, and governance tools, Understanding of

IAM roles, data security, and compliance in GCP.

For employers only

Is this your company's job post? Verify ownership to manage this listing and receive applications directly.

Claim this listing

Looking to apply for this job? Use the Apply button above.

See more jobs in Sydney, New South Wales