Title: Cloud Data Engineer - 8+Role SummaryLooking for an 8+ Yrs experienced Cloud Data Engineer - Lead with solid AWS / Azure / GCP experience and in-depth knowledge on multi integrations ETL processing methods (API/DB/Event), knoweldge on CI/CD pipelines. Experience working with Parquet/JSON/Avro/Iceberg/Databricks. Strong SQL skills and excellent communication are essential.Atleast 1 Cloud "Data Engineering" or above certification from AWS (Preferable) or Azure or GCP (NOT practitioners).Key Responsibilities- Develop, optimize, and maintain PySpark-based data processing pipelines for large-scale data workloads. - Design and implement ETL/ELT processes, including API data ingestion, database extracts, and ingestion of semi-structured data (JSON, Parquet, Avro, etc.). - Build and maintain CI/CD pipelines for data engineering workloads (code, tests, deployments, and monitoring) with data quality checks, logging, and error handling to ensure robust data pipelines. - Optimize SQL queries and data models for performance and scalability. - Contribute to documentation, best practices, and knowledge sharing within the team.Qualifications- 8+ years of hands-on experience in data engineering. - Proficiency in PySpark and Spark-based data processing with Parquet/JSON/Avro/Iceberg/Databricks. - Solid cloud experience (AWS or Azure or GCP) with data services (e.g., AWS Glue/SageMaker, EMR/Redshift; Azure Data Factory/Databricks; GCP BigQuery/Dataflow/Dataproc, AirFlow, etc). - Strong understanding of CI/CD concepts and experience implementing pipelines (e.g., Git, CI servers, containerization, automated testing, deployment automation). - Deep SQL expertise (query tuning, performance optimization, complex joins, window functions). - Excellent communication skills and ability to collaborate with cross-functional teams. - Familiarity with big data processing frameworks, data modeling, and data governance concepts.Nice-to-have- Experience with streaming data (Kafka/Kinesis), and real-time processing. - Knowledge of data visualization or BI tools (Power BI, Tableau) is a plus.What We Offer- Hybrid work culture with a mix of on-site and remote work - Competitive salary and comprehensive benefits - Flexible work arrangements and a supportive, collaborative team - Opportunities to work on impactful, scalable data platforms - Professional development support and certification encouragement
Job Title
Senior Data Engineer