OverviewWe are seeking an ETL Developer to join our team and assist with optimising a critical data processing system. This position will require you to lead the transformation of a high volume data pipeline, reducing processing times and improving feedback loops for the clients services. The key objective of the engagement would be to reduce extract processing times and improve end-to-end data flows.ResponsibilitiesEnhance existing ETL code and rebuild indexes in SQL staging tables.Establish four new Azure queues aligned with sending applications and supported by SQL Server Agent jobs for parallel execution.Assist with a redesign of the queuing architecture.Develop a proof of concept and technical review.Key Selection Criteria3-5 Years ETL Development experienceProficient with Azure Data Services - ADF, Databricks, Datalake etcExperience working within the government sector is highly regardedETL Development Skills SoughtETL, SSIS, SQL, T-SQLAdvanced T-SQL capabilities: stored procedures, views, indexes, and performance tuning.Ability to analyse large datasets and design efficient data flow models.Experience implementing data marts, data stores, and data lakes.Skills with performance tuning and resource-efficient data modeling.Seniority levelMid-Senior levelEmployment typeContractJob functionInformation TechnologyReferrals increase your chances of interviewing at Elysium Digital by 2xGet notified about new Data Engineer jobs in Melbourne, Victoria, Australia.#J-18808-Ljbffr
Job Title
Data Engineer - ETL Development