Job Location: HyderabadWhat You Will Do:- Develop and maintain data pipelines using Azure Data Factory (ADF) /Databricks for data integration and ETL processes. - Design, implement, and optimize Power BI /Fabric reports and dashboards to deliver actionable business insights. - Collaborate with data analysts, business users, and other teams to understand data requirements and deliver solutions using ADF and Power BI. - Extract, transform, and load (ETL) data from various sources into cloud-based storage systems such as Azure Data Lake or Azure SQL Database. - Work with large datasets and optimize queries and pipelines for performance and scalability. - Ensure data quality, integrity, and availability throughout the data lifecycle. - Automate repetitive data tasks, ensuring timely and accurate reporting. - Monitor and troubleshoot data pipelines, addressing any performance or data issues promptly. - Support data visualization and reporting tools, including Power BI, to enable business stakeholders to make data-driven decisions. - Write clear, efficient, and maintainable code for data transformations and automation.Required Qualifications:- Bachelor's degree in computer science, Information Technology, Engineering, or a related field. - 8+ years of hands-on experience in Data Engineering, BI Developer or a similar role. - Proficiency with Azure Data Factory (ADF), including the creation of data pipelines and managing data flows. - Strong experience in Power BI, including report creation, dashboard development, and data modeling. - Experience with SQL and database management (e.g., Azure SQL Database, SQL Server). - Knowledge of cloud platforms, especially Microsoft Azure. - Familiarity with data warehousing concepts and ETL processes. - Experience working with cloud-based data storage solutions (e.g., Azure Data Lake, Azure Blob Storage). - Strong programming skills in languages such as Python, SQL, or other relevant languages. - Ability to troubleshoot and optimize data pipelines for performance and reliability.Preferred Qualifications:- Familiarity with data modeling techniques and practices for Power BI. - Knowledge of Azure Databricks or other data processing frameworks. - Knowledge of Microsoft Fabric or other Cloud Platforms.What we need?- B. Tech computer science or equivalent.
Job Title
Data Engineering Lead