Job Title

Job Title:Python Databricks Developer Location:Pune Experience:6 to 10 Years Employment Type:Full-TimeJob Summary: We are looking for a skilled and experiencedPython Databricks Developerwho is proficient in developing scalable data pipelines, data transformation logic, and cloud-native analytics solutions usingPython, Databricks , andAWSservices. The ideal candidate should have strong data engineering experience and be comfortable working in fast-paced, Agile environments. Key Responsibilities: Design and develop scalableETL pipelinesanddata workflowsusingDatabricks (PySpark)andPython . Work on large-scale data ingestion, processing, and transformation from various sources. LeverageAWS services(e.g., S3, Glue, Lambda, Redshift, EMR) for data storage, orchestration, and compute. Optimize performance of Spark jobs and Databricks notebooks for large-scale data operations. Collaborate with data architects, analysts, and business stakeholders to deliver robust data solutions. Implement best practices for data quality, data governance, and security. Participate in code reviews, testing, and deployment of data solutions in DevOps-driven environments. Create and maintain technical documentation, data dictionaries, and process flows. Required Skills & Experience: Strong hands-on programming experience inPython . Minimum 4+ years of experience working withDatabricks , especially withPySparkandDelta Lake . Experience in building and managing data pipelines and ETL processes incloud environments , particularlyAWS . Solid understanding of distributed computing concepts andSparkperformance optimization. Hands-on experience withAWS servicessuch asS3, Glue, Lambda, Redshift, Athena, CloudWatch , etc. Experience with version control (e.g., Git), CI/CD tools, and workflow orchestration tools likeAirfloworDatabricks Jobs . Knowledge of data modeling, data warehousing, and data lake architectures. Strong problem-solving skills and the ability to work independently or in a team. Preferred Qualifications: Bachelor's or Master’s degree in Computer Science, Information Technology, or related field. Certification inAWSorDatabricksis a plus. Experience working in Agile environments with Jira or similar tools. Familiarity withSQLand NoSQL databases is a plus.