Job Title:Lead Data Engineer – Databricks & Microsoft Fabric Location:Hyderabad / Ahmedabad Experience:8+ YearsAbout the Role We are looking for aLead Data Engineerwith a strong foundation indata warehousing ,cloud-native data engineering , and deep hands-on experience withDatabricks . Exposure toMicrosoft Fabricis a strong plus. In this role, you will lead the design and development of modern data pipelines, drive enterprise data transformation initiatives, and contribute to a future-ready data architecture that blends best practices across Databricks, Azure, and Fabric. This is a strategic role for a data expert who enjoys solving high-impact business problems through modern data platforms, scalable pipelines, and cloud-native tools.Key Responsibilities Data Engineering & Architecture Design and implement scalable, high-performancedata pipelinesonDatabricksusingPySpark ,SQL , andDelta Lake . Develop and optimizedata lakehouse architectures , ensuring robust data ingestion, transformation, and storage. Build and manageETL/ELT workflowsintegrating structured and semi-structured data from diverse sources. Apply best practices in data modeling, partitioning, and performance tuning. ☁️Cloud & Platform Integration LeverageDatabricks on Azurefor large-scale distributed processing, including job orchestration and notebook management. Work onMicrosoft Fabricfor pilot or hybrid scenarios—Power BI integration, OneLake, DirectLake, or Synapse pipelines. Collaborate with platform teams to enablesecure ,scalable , andgoverned data environmentsacross cloud ecosystems. Solutioning & Collaboration Partner with business analysts, architects, and client stakeholders to translate business needs into scalable data solutions. Ensure data quality, lineage, and observability through tools likeUnity Catalog ,Great Expectations , orAzure Purview . Guide and mentor junior engineers, enforce code and design standards, and drive adoption of reusability and best practices. Document technical designs, data flow diagrams, and data governance procedures.Required Skills & Experience 6+ yearsof experience inData Engineering , with focus ondata warehousing ,distributed processing , andcloud platforms . 3+ yearsof hands-on experience inDatabricks : PySpark, Delta Lake, MLflow (optional). Proficient inSQL ,data modeling , andperformance tuningfor analytical workloads. Experience building scalable pipelines onAzure(ADF, Synapse, or Azure Functions). Understanding ofdata governanceprinciples, RBAC, and metadata management.Preferred / Bonus Skills Exposure toMicrosoft Fabriccomponents: OneLake, Lakehouse, Data Activator, or Power BI within Fabric ecosystem. Knowledge ofMedallion architecture ,CDC patterns , orevent-driven data processing . Familiarity withUnity Catalog ,Azure Purview ,Databricks SQL , anddata observability tools . Certification:Databricks Certified Data Engineer Associate/Professional ,Microsoft Azure Data Engineer .Why Join Us Be part of an innovation-driven team modernizing enterprise data ecosystems. Lead high-impact data initiatives with global customers across industries. Work with cutting-edge technologies likeDatabricks ,Microsoft Fabric , andmodern Azure stack . Accelerate your career in a cloud-native, AI-ready data engineering environment.
Job Title
Lead Data Engineer – Databricks & Microsoft Fabric