Exclaim IT

Data engineers

Canberra, Australian Capital Territory, AustraliaUSD 47
Apply on company site

About the role

**About the role** We are seeking an experienced Data Engineer with strong Google Cloud Platform (GCP) expertise to design, develop and maintain scalable, secure and reliable data solutions within a complex enterprise environment. **Please note: A current Negative Vetting Level 1 (NV1\) security clearance is mandatory for this position.** **Location of work : QLD, WA, ACT, VIC, NSW, NT, SA and TAS.** **Key responsibilities** * Design, develop and maintain scalable batch, micro\-batch and real\-time data ingestion, transformation and curation pipelines. * Translate solution designs, technical specifications and data contracts into robust, production\-ready data solutions. * Apply data warehousing, dimensional modelling, data quality and governance principles, including metadata, lineage, classification, retention and security. * Develop and optimise data pipelines using GCP services, including BigQuery, Dataflow, Apache Beam, Cloud Storage, Cloud Composer and Pub/Sub. * Implement DataOps practices, including CI/CD, infrastructure automation, automated testing, monitoring, alerting and release management. * Identify and address gaps between solution designs and technical implementation, ensuring requirements are fully realised. * Optimise data solutions for performance, scalability, reliability, cost efficiency and operational supportability. * Apply security best practices, including least\-privilege access, encryption, secrets management and secure handling of sensitive information. * Build and maintain automated unit, integration, reconciliation and data quality tests for data pipelines and products. * Collaborate with technical teams and business stakeholders throughout the solution delivery lifecycle. * Identify technical risks, dependencies and design deficiencies, recommending sustainable improvements. * Contribute to technical analysis, estimation, solution planning, standardisation and continuous improvement initiatives. * Develop reusable data products and trusted datasets to support advanced analytics, machine learning and generative AI. **Highly desirable criteria** * Minimum three years of data engineering experience, including at least two years designing, building and operating production data solutions on Google Cloud Platform (GCP). * Demonstrated experience delivering and supporting production\-grade data pipelines in complex enterprise environments. * Strong hands\-on experience with BigQuery, including data modelling, partitioning, clustering, query optimisation, cost management and workload monitoring. * Experience developing scalable batch and streaming data pipelines using Dataflow and Apache Beam. * Demonstrated experience applying data warehousing, dimensional modelling and data quality practices. * Strong proficiency in SQL and Python for developing, testing and optimising data pipelines. * Experience implementing DataOps practices, including CI/CD, infrastructure as code, automated testing and monitoring. * Hands\-on experience with Terraform, Git\-based source control and CI/CD tooling such as Cloud Build or GitHub Actions. * Demonstrated understanding of cloud security, data governance, metadata management and data lifecycle principles. * Ability to translate business and technical requirements into scalable, secure and maintainable data solutions. **Contact details** For a confidential chat, please contact **Shruthi on 0474 545 379 or via email at shruthi@exclaim\-it.com.au .** We would be more than happy to provide you with additional information and assist in the application process. Please note that a National Police Check might be required as part of pre\-employment screening.

Applying with JobFu tracks this in your pipeline automatically.

Free AI résumé tailoring, interview prep, and matches across 40+ countries.

Apply on company site