Job Title

Role: Senior Data Engineer Experience: 8 plus Years Location: Kolkata Role**Senior Data Engineer Required Technical Skill Set** Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI/CD, Data Governance, Purview, Informatica Desired Competencies (Technical/Behavioral Competency) Must-Have** Strong proficiency in Azure Data Factory, Databricks, Delta Live Tables Solid experience with Python, SQL, YAML, and Terraform Hands-on experience in building and optimizing scalable data pipelines Expertise in Data Warehousing, Lakehouse Architecture, and Data Modelling Knowledge of CI/CD practices and data governance tools like Purview or Informatica Good-to-Have Experience in Machine Learning integration and collaboration with data scientists Knowledge of metadata management and observability frameworks Strong stakeholder engagement and communication skills Experience in Australian Energy or Utilities domain Responsibility of / Expectations from the Role 1 Design, build, and optimize scalable data pipelines using Azure Data Factory, Databricks, and Delta Live Tables. 2 Implement ETL processes across diverse data assets ensuring data quality and performance. 3 Develop and manage data warehouses and lakehouses for structured and semi-structured data. 4 Ensure compliance with data security, governance, and privacy standards using Purview and Informatica. 5 Collaborate with data scientists and ML engineers to operationalize machine learning pipelines. 6 Implement CI/CD pipelines for automating data pipeline deployments. 7 Translate complex technical solutions into business insights for stakeholders. 8 Troubleshoot and resolve performance bottlenecks in data workflows.