Job Title

Creospan is a growing tech collective of makers, shakers, and problem solvers, offering solutions today that will propel businesses into a better tomorrow. “Tomorrow’s ideas, built today!” In addition to being able to work alongside equally brilliant and motivated developers, our consultants appreciate the opportunity to learn and apply new skills and methodologies to different clients and industries.Title: DATAENGINEER - AZURE DATABRICKS Location: Pune Looking for Immediate joiners or someone already serving notice.Job Title: Azure Databricks EngineerExperience:6–10 Years Location:Pune, India (Hybrid) Employment Type:Full TimeAbout the RoleWe are seeking an experiencedAzure Databricks Engineerto join its data engineering team in Pune. This role focuses on building, optimizing, and supporting enterprise-scale data platforms onMicrosoft Azure , leveragingAzure Databricks ,Apache Spark , and modern data engineering practices. The engineer will work closely with global teams to deliver secure, scalable, and high-performance analytics solutions.Key Responsibilities • Design, develop, and maintain scalable data pipelines usingAzure Databricks • Build and optimizebatch and streaming ETL/ELT workflowsusingApache Spark • Develop data processing solutions usingPySpark ,Spark SQL , andDelta Lake • Integrate data from multiple Azure sources such asAzure Data Lake Storage (ADLS Gen2) ,Azure SQL , and APIs • Optimize Spark jobs for performance, cost efficiency, and reliability on Azure • Implement data quality, validation, and reconciliation frameworks • Collaborate with data architects, analysts, and business stakeholders • Ensure adherence todata security, governance, and compliance standards • Support production deployments and troubleshoot pipeline failuresRequired Skills & Qualifications • 6–8 years of experience inData Engineering • Strong hands-on experience withAzure Databricks(mandatory) • Deep expertise inApache Spark ,PySpark , andSpark SQL • Experience working withAzure Data Lake (ADLS Gen2) • Hands-on experience withAzure Data Factory (ADF)for orchestration • Strong SQL skills and experience with relational databases • Experience withCI/CD pipelines(Azure DevOps preferred) • Working knowledge ofcloud security and access controlson Azure