Job Title

1 week ago Be among the first 25 applicantsDirect message the job poster from easyA - Recruitment made easyTechnical Recruiting Specialist | IT Recruitment, HiringThe Data Engineer role is responsible for ensuring fit for purpose data warehouse solutions are built for use across the Bank, utilising best practice ETL standards to ensure the data is trusted by our key business consumers.Reporting to the Senior Manager, Data Engineering, the Data Engineer role is responsible for ensuring fit for purpose data warehouse solutions are built for use across the Bank, utilising best practice ETL standards to ensure the data is trusted by our key business consumers. Liaising closely with the Lead and Senior Data Engineers, this role will design, build and deploy data pipelines with a strong focus on embedding automation and process simplifications. In addition, actively contributing to the adoption of uplifting the Data Engineering practice through standardised methods, mentorship and continuous improvements in core Engineering competencies (such as environment management, testing, release management, source control and database administration), is a key expectation of this position.Requirement:3+ years of experience in design and development of data and analytics applications and solutions3+ years of experience across design, development and maintenance of complex data warehouses/data lakesStrong skills in data engineering and functional programming - expertise in Python is mandatoryStrong skills in data engineering and one or more functional programming languages: Python, Scala, JavaDemonstrated experience in implementing big data solutions in cloud (AWS/Azure) using Spark/Databricks is essentialProven experience in distributed technologies such as Spark or HadoopProven Experience with Data Lake, Data Solutions and Data PipelinesExperience building and optimising data pipelines using Azure Data FactoryExperience working in a DevOps, CI/CD environmentExpertise in configuration, integration and data of banking applications desirable.Responsibilities include:Develop according to business requirements and provide third level operational support of our Data Warehouse, and other related data analytics support systems in production and non-production environments as required.Design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management. The ability to work with both IT and business in integrating analytics and data science output into business processes and workflows.Work with heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional data integration technologies. These should include ETL/ELT, data replication/CDC, message-oriented data movement, API design and access and upcoming data ingestion and integration technologies such as stream data integration, CEP and data virtualization.Work with solution designers / architects, analysts, project managers, business SMEs, vendors and contractors to design, build and deploy new data solutions or enhancements to existing data solutions.Assist with planning and execution of unit, integration and user acceptance testing.Interpret business requirements to determine the solution required to implement new functionality within the data warehouse.Actively contribute towards optimizing existing ETL processes and data integration and data preparation flows and helping to move them in production.Transfer data warehouse knowledge to operational support team(s) and recommend tools and techniques that will assist with trouble shooting, automation and remediation of operational issues and processes.Actively contribute towards the adoption of uplifting the Data Engineering practice through standardised methods, mentorship and continuous improvements in core Engineering competencies.Follow agile methodologies, DevOps techniques and increasingly DataOps principles to data pipelines to improve the communication, integration, reuse and automation of data flows between data managers and consumers across an organization.Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeFull-timeJob functionJob functionEngineering and Information TechnologyIndustriesBanking, Data Infrastructure and Analytics, and Information ServicesReferrals increase your chances of interviewing at easyA - Recruitment made easy by 2xGet notified about new Data Engineer jobs in Brisbane, Queensland, Australia.Brisbane, Queensland, Australia 1 week agoScarborough, Queensland, Australia 4 days agoBrisbane, Queensland, Australia 2 weeks agoBrisbane, Queensland, Australia 2 days agoBrisbane, Queensland, Australia 2 days agoBrisbane, Queensland, Australia 2 weeks agoBrisbane, Queensland, Australia 1 week agoBrisbane, Queensland, Australia 3 weeks agoBrisbane, Queensland, Australia 2 weeks agoBrisbane, Queensland, Australia 3 weeks agoBrisbane, Queensland, Australia A$130,000.00-A$160,000.00 2 weeks agoBrisbane, Queensland, Australia 1 week agoBrisbane, Queensland, Australia 2 weeks agoBrisbane, Queensland, Australia 3 weeks agoBrisbane, Queensland, Australia 13 hours agoBrisbane, Queensland, Australia 3 days agoHerston, Queensland, Australia 3 weeks agoBrisbane, Queensland, Australia A$140.00-A$143.00 3 weeks agoBrisbane, Queensland, Australia 1 day agoWest Ipswich, Queensland, Australia 1 week agoBrisbane, Queensland, Australia 2 days agoBrisbane, Queensland, Australia A$100.00-A$150.00 3 weeks agoBrisbane, Queensland, Australia 1 week agoBrisbane, Queensland, Australia 3 weeks agoBrisbane, Queensland, Australia A$130,000.00-A$140,000.00 15 hours agoIpswich, Queensland, Australia 11 hours agoBrisbane, Queensland, Australia 2 weeks agoBrisbane, Queensland, Australia A$120,000.00-A$143,000.00 1 week agoPython and Kubernetes Software Engineer - Data, AI/ML & AnalyticsBrisbane, Queensland, Australia 3 months agoBrisbane, Queensland, Australia 2 weeks agoData Analyst and Power Platform DeveloperBrisbane, Queensland, Australia 1 week agoBrisbane, Queensland, Australia 1 day agoScarborough, Queensland, Australia 2 weeks agoBrisbane, Queensland, Australia A$850.00-A$950.00 1 week agoBrisbane, Queensland, Australia 2 days agoBrisbane, Queensland, Australia 2 weeks agoWere unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr