Job Title

Responsibilities5 years in a data engineering or closely related role.Design, build, and optimise batch and streaming data pipelines using approved frameworks and tooling using Azure Databricks.Ensure pipelines are resilient, performant, and cost optimised.Implement monitoring, alerting, and automated recovery processes.Apply data quality checks and reconciliation processes to ensure accuracy and completeness.Maintain metadata, lineage, and documentation to support governance requirements.Adhere to role-based access control, data privacy, and security standards.Contribute to the development and maintenance of ingestion frameworks, transformation layers, and data models.Implement and maintain CI/CD pipelines for automated testing and deployment.Optimise data storage and retrieval strategies to meet performance needs.Work closely with Technical Leads, Data Architects, Analysts, and business stakeholders to deliver fit for purpose solutions.Participate in code reviews and knowledge sharing sessions to improve team capability.adopt new tools, frameworks, and techniques to enhance engineering capability.Identify opportunities to automate and streamline workflows.Key Skills & ExperienceTechnical SkillsProficient in SQL for data wrangling, transformation, and analysisStrong programming skills in Python, Scala, or JavaExperience building ETL/ELT pipelines in cloud or distributed environmentsFamiliarity with cloud platforms and servicesKnowledge of data modeling conceptsExperience with data orchestration toolsFamiliar with version control and CI/CD pipelinesUnderstanding of data quality, validation, and observability practicesWorks independently with minimal supervision on well scoped tasksCollaborates effectively with stakeholdersCommunicates clearly and documents work for others to maintain or build uponOpen to code reviews, feedback, and continuous learningAble to troubleshoot and resolve data pipeline failures or performance issuesInterested Candidates can share their updated resumes on [email protected] or can reach me on +61 251 103 879. #J-18808-Ljbffr