Job Title

About Ganit AtGanit , we are not just data geeks – we are a family of scientists, refiners, and artisans. Our mission is to bridge the gap between intelligence and action, translating data into actionable insights and strategies. Since our incorporation in 2017, we have grown into a team of 150+ data scientists, analysts, and engineers who create state-of-the-art solutions that push the boundaries of data science. We work with businesses to maximize decision velocity and minimize decision risk, helping them make data their voice. More about us: Role Overview We are looking for a highly skilledSenior / Lead Data Engineerto join our growing team. You will design, develop, and maintain scalable data architectures and pipelines, lead or mentor a high-performing data engineering team, and collaborate with clients and cross-functional stakeholders to support data-driven decision-making across the organization. This role offers a unique opportunity to combinehands-on technical expertisewithleadership and client-facing responsibilities . Key Responsibilities Data Engineering & Pipeline Development Design, implement, and maintain robust ETL/ELT pipelines for batch and real-time data processing using formats like JSON, Parquet, CSV, and ORC. Lead cloud migration projects, optimizing Spark code and ensuring scalable, efficient pipelines. ImplementMedallion Architecture(Bronze, Silver, Gold tables) for organized and scalable data systems. Develop and maintainDelta Live Table (DLT) pipelinesfor secure, tamper-resistant data management. Ensure data quality through validation, monitoring, cataloging strategies (Unity Catalog), and governance best practices. Data Architecture & Cloud Management Design scalable, efficient, and secure data architectures, including data lakes, warehouses, and NoSQL systems. Define data models, schemas, and storage strategies aligned with business goals. Manage cloud infrastructure on AWS, Azure, or GCP; monitor and optimize resource usage and costs. Ensure high availability, disaster recovery, and compliance with data security regulations (e.g., GDPR, CCPA). Leadership & Team Management Lead, mentor, and develop a team of data engineers, fostering collaboration and continuous learning. Conduct code reviews, enforce best practices, and maintain high-quality deliverables. Identify skill gaps, coordinate training, and participate in hiring when required. Act as a bridge between technical teams, business stakeholders, and clients, translating requirements into scalable data solutions. Innovation & Continuous Improvement Stay up-to-date with emerging trends in data engineering, cloud platforms, and big data technologies. Evaluate new tools and technologies, implementing improvements to enhance efficiency and scalability. Lead proof-of-concept initiatives to drive innovation across the data ecosystem. Documentation & Knowledge Sharing Create and maintain technical documentation for architectures, data flows, and pipelines. Build a team knowledge base and lead internal training sessions or workshops. Qualifications Experience 5–10+ years of hands-on experience in data engineering, with exposure to cloud migrations, big data pipelines, and modern data architectures. ForLead-level , 3+ years of experience in leadership or architectural roles is preferred. Education Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field. Technical Skills Big data tools: Apache Spark, Kafka, or similar. Programming: Python, SQL. Cloud platforms: AWS, Azure, or GCP; familiarity with DevOps tools (Docker, Kubernetes, Terraform) is a plus. Experience in designing ETL/ELT pipelines, data warehouses, and real-time/batch processing. Knowledge of data modeling, Medallion Architecture, Delta Live Tables, and data governance best practices. Soft Skills Strong communication and collaboration abilities, capable of working with clients and internal teams. Leadership, mentoring, and stakeholder management skills. Customer-oriented mindset with an aptitude for problem-solving and innovative solutions. Certifications (Optional) AWS / GCP / Azure Data Engineer certifications are a plus.