Job Title

Skill: Big Data EngineerExperience: 5 to 8 yearsLocation: Pune preferred, Mumbai ,Chennai, Bangalore HyderabadSkills: Big Data Engineer, Spark, Java, Apache IcebergJob Description We are seeking a skilled Big Data Engineer with hands on experience in Apache Spark Java and Apache Iceberg to design and develop scalable data processing solutions The ideal candidate will build high performance ETL pipelines optimize data lake architectures and ensure reliability quality and efficiency across largescale datasets Key ResponsibilitiesDevelop and optimize distributed data processing pipelines using Apache Spark JavaDesign build and maintain Iceberg based data lake tables with strong focus on ACID transactions schema evolution and time travel capabilitiesImplement efficient data ingestion transformation and storage strategies using Parquet ORCCollaborate with data architects product teams and DevOps to deliver scalable production rade data solutionsTroubleshoot performance issues and ensure high availability of data systemsRequired SkillsStrong programming experience in Java with deep understanding of Spark APIsHandson experience working with Apache Iceberg in real world data lake implementationsSolid understanding of distributed computing file formats Parquet Avro ORC and data lake architecturesExperience with cloud platforms AWS, Azure, GCP is a plusFamiliarity with SQL versioned datasets and metadata management