Join or sign in to find your next jobJoin to apply for the Senior Data Engineer role at Troocoo2 weeks ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer role at TroocooDesign, build, and maintain scalable data pipelines and ETL processes using Azure Data Factory for data ingestion from diverse sources including on-premises databases (Authority), API-based CAMMS, and data files in CSV and JSON formats.Utilize Azure Data Lake Storage (Gen2) and Delta Lake for managing data in different stages (Bronze, Silver, Gold).Implement data processing workflows using Azure Databricks to transform raw data into processed high-quality data assets.Develop and optimize data models in Databricks and Power BI ensuring they meet performance and scalability requirements.Enable advanced analytics capabilities by providing clean, structured, and reliable data for analysis and reporting using Azure Databricks and Power BI.Implement and manage DevOps practices for continuous integration and continuous deployment (CI/CD) to enhance data engineering workflows through Git integration.Establish and enforce data standards, policies, and procedures including a data quality framework to ensure the accuracy, completeness, and consistency of data.Support the Data and Insights teams by providing efficient data access and processing tools on Azure.Monitor, support, and improve the technology landscape, including maintenance and cost savings.Assist the Team Leader with remediation activities identified from internal and external audits.Key responsibilities include;Design, build, and maintain scalable data pipelines and ETL processes using Azure Data Factory for data ingestion from diverse sources including on-premises databases (Authority), API-based CAMMS, and data files in CSV and JSON formats.Utilize Azure Data Lake Storage (Gen2) and Delta Lake for managing data in different stages (Bronze, Silver, Gold).Implement data processing workflows using Azure Databricks to transform raw data into processed high-quality data assets.Develop and optimize data models in Databricks and Power BI ensuring they meet performance and scalability requirements.Enable advanced analytics capabilities by providing clean, structured, and reliable data for analysis and reporting using Azure Databricks and Power BI.Implement and manage DevOps practices for continuous integration and continuous deployment (CI/CD) to enhance data engineering workflows through Git integration.Establish and enforce data standards, policies, and procedures including a data quality framework to ensure the accuracy, completeness, and consistency of data.Support the Data and Insights teams by providing efficient data access and processing tools on Azure.Monitor, support, and improve the technology landscape, including maintenance and cost savings.Assist the Team Leader with remediation activities identified from internal and external audits.Key requirements;Bachelors degree or above in Computer Science, Data Engineering, Information Systems, or a related field.5+ years of experience in data engineering, data modelling, data management, and data governance using Azure cloud services.Strong expertise in data architecture, ETL processes, and data modelling on Azure.Proficiency in programming languages such as Python and SQL with demonstratable experience in Azure Data Factory, Azure Databricks, and other Azure data services.Experience with DevOps practices, including CI/CD pipelines.Experience in ingesting data from on-premises RDBMS databases, APIs, and various formats like CSV, XLS and JSON.Data governance in Azure Purview and Unity Catalog.Strong analytical and problem-solving skills with the ability to translate business requirements into technical solutions.Excellent communication and collaboration skills to work effectively with cross-functional teams.Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeFull-timeJob functionJob functionInformation TechnologyIndustriesIT Services and IT Consulting, Advertising Services, and Financial ServicesReferrals increase your chances of interviewing at Troocoo by 2xGet notified about new Senior Data Engineer jobs in Sydney, New South Wales, Australia.Software Engineer, Early Career, NetSoftSydney, New South Wales, Australia 3 days ago2025 Software Development Graduate (AWS, Auckland,NZ), (0-2 Years, Entry-Level)Sydney, New South Wales, Australia 1 day agoSydney, New South Wales, Australia 2 weeks agoSoftware Development Graduate (2025, AWS)Sydney, New South Wales, Australia 5 days agoNorth Sydney, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 2 weeks agoSoftware Engineer, 2025/2026 Intern Australia & New ZealandSydney, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 3 days agoSydney, New South Wales, Australia 2 weeks agoIntern Software Engineer - Multiple RolesSydney, New South Wales, Australia 1 month agoSydney, New South Wales, Australia 2 weeks agoNorth Sydney, New South Wales, Australia 2 days agoSydney, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 4 days agoSydney, New South Wales, Australia 4 hours agoSydney, New South Wales, Australia 2 months ago2025 Australia Software Engineering InternshipSydney, New South Wales, Australia 3 days agoSydney, New South Wales, Australia 2 weeks agoSoftware Engineers - Mid/Senior - (Typescript, React, Node, AWS)Sydney, New South Wales, Australia 2 months agoSoftware Engineers - AI Team (Typescript/Node/React/AWS)Sydney, New South Wales, Australia 1 month agoSydney, New South Wales, Australia 3 weeks agoSydney, New South Wales, Australia 2 weeks agoBackend Engineer (Java), Media Platform - Global Content and Discovery (open to remote across ANZ)Mid-Level Software Engineer (2 Positions)Sydney, New South Wales, Australia 2 weeks agoBaulkham Hills, New South Wales, Australia 1 day agoSoftware Engineering Internship (Dec 2025 - March 2026)Sydney, New South Wales, Australia 2 weeks agoSoftware Engineer (Python) - Data Platform (Open to remote across ANZ)Mid-Level Software Engineer (2 Positions)Sydney, New South Wales, Australia 1 month agoWere unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr
Job Title
Senior Data Engineer