DATABRICKS TECH LEAD

ALOIS Australia is a leading Talent and Technology Solutions company, focused on helping businesses across the country build stronger teams, smarter processes, and sustainable growth.

We work with organisations in diverse industries to deliver integrated workforce and technology solutions, from innovative hiring strategies to end-to-end digital transformation. Our approach combines data, insight, and human expertise to help clients solve complex workforce challenges with clarity and confidence.

Through our deep industry experience and commitment to excellence, we provide scalable, high-performance solutions that deliver measurable impact. Whether it’s onshore project delivery, workforce optimisation, or specialised technology services, ALOIS Australia ensures results that truly make a difference.

From Sydney to Perth and everywhere in between, we’re driven by one purpose: to empower Australian businesses and professionals to thrive in a rapidly changing world of work. At ALOIS Australia, every challenge is an opportunity to innovate, and every partnership is built on trust, transparency, and long-term success.

Job Title – Databricks Tech Lead

Job Location – Sydney

Employment Type – Contract/FTC

Role Overview

We are seeking a seasoned

Databricks Tech Lead to design, build, and scale our next-generation data ingestion and processing framework. In this role, you will lead a team of data engineers, champion best practices in software development, and build reusable, highly scalable pipelines to ingest and transform data from diverse enterprise sources into our Lakehouse platform.

Key Responsibilities

• Framework Development: Design and build metadata-driven, generic data ingestion frameworks (batch, streaming, and CDC) to automate the onboarding of new data sources.
• Architecture & Design: Define architectural standards for the Medallion architecture (Bronze, Silver, Gold layers) utilizing Delta Lake.
• Technical Leadership: Lead technical design discussions, mentor junior/mid-level engineers, and conduct rigorous code reviews.
• Pipeline Optimization: Optimize Spark jobs for performance, scalability, and cost reduction across the Databricks platform.
• CI/CD & DevOps: Implement and mature CI/CD pipelines (Git, automated testing) for data platforms and enforce DataOps best practices.
• Governance & Security: Integrate ingestion pipelines with Unity Catalog for enterprise-grade data governance and lineage tracking.

Required Qualifications

• Experience: 8+ years in Data Engineering, with at least 3–4 years of hands-on technical leadership experience leading engineering pods.
• Core Databricks & Spark: Advanced proficiency in PySpark and Databricks SQL.
• Ingestion Expertise: Proven experience building custom or highly configurable data ingestion frameworks for structured and unstructured data.
• Cloud Platforms: Strong experience working with AWS, Azure, or GCP cloud-native services (e.g., S3, ADLS).
• Engineering Standards: Deep understanding of data modeling (star/snowflake schemas), SCD (Slowly Changing Dimensions), and software engineering principles in a data context.
• Soft Skills: Excellent stakeholder management and the ability to translate complex technical architectures into business value.

Preferred Qualifications

• Experience with Kafka, dbt, or Delta Live Tables (DLT).
• Databricks Certified Data Engineer Associate/Professional credentials

Stay Connected With Us

Learn more about ALOIS in Australia, visit our webpage ALOIS Australia

Follow us on LinkedIn and Instagram

EEO Statement

ALOIS Australia is committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all qualified applicants and do not discriminate on the basis of race, colour, religion, sex, age, national origin, disability, or any other characteristic protected under applicable laws. We value diversity and believe it strengthens our people, our culture, and the outcomes we deliver.