About the Role Term: 1 yr contract to PERMANENT Address : Pune, Maharashtra 411045, India 100% onsite Amenable to wear formal attire and drug testing We are seeking a highly skilled Senior Data Engineer to join our agile, fast-paced team on a long-term contract. You’ll work alongside 17 team members based in India and collaborate closely with a time-conscious Hiring Manager to design and implement complex, large-scale data solutions. This role requires deep expertise in building robust, secure, and scalable pipelines—from scratch—handling billions of rows and large data structures (e.g., 2M+ chassis records). You will work in a cloud-native environment with a focus on AWS (preferred) and Azure, leveraging modern tools like Kafka, Terraform, GitHub, SQL, PostgreSQL, and Python. POSITION PURPOSE As a Senior Data Engineer, you will be responsible for designing and implementing scalable data pipelines, managing complex ETL processes, and optimizing SQL Server databases. You will collaborate closely with cross-functional teams to deliver robust data solutions that drive operational efficiency and strategic decision-making. Your work will directly support applications that are vital to both internal and external stakeholders, where system reliability is paramount to business continuity. This position offers the opportunity to work with modern data technologies, contribute to mission-critical systems, and play a pivotal role in shaping the data strategy of a dynamic and forward-thinking organization. KEY RESPONSIBILITIES Design, develop, and maintain scalable data pipelines and systems. Write efficient and maintainable Python code for data processing and automation. Develop complex SQL queries to extract, transform, and load data. Manage and optimize databases, SQL Server. Integrate and manage data from various sources using REST APIs and data servers. Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions. Ensure data quality, integrity, and security across all data platforms. Troubleshoot and resolve data-related issues promptly. Overall, as the Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure on the largest project in our organization. You will work closely with cross-functional teams to ensure the efficient and effective use of data across the organization. You are partly responsible for managing the systems used by Aftersales, Marketing & Sales, Parts, and North American and European dealers. These applications are used inside and outside our company, mainly for commercial and operational processes and purposes. Failure of these systems often means that the business comes to a partial standstill. APPLICATION DEVELOPMENT Participate in Agile/Waterfall application development and delivery processes. Assist in deriving application requirements via Agile feature and user story development. Contribute to the research and definition of application maintenance requirements. Follow security best practices, processes, and procedures as cross-cutting concerns. Utilize DevOps best practices for source control repositories, automated testing, and CI/CD. Develop pragmatic secure solutions, unit & integration tests, and DevOps pipelines. Utilize Integrated Development Environments (IDEs) to create software solutions. Participate in paired programming, code review, and defect triage activities. Provide tier-2 application defect resolution & sustaining support. GENERAL Effectively communicate to stakeholders for clarity and definition Make presentations to the management team and professional peers. Be on-call to support business-critical apps/systems in emergencies. EXPERIENCE AND TRAINING GUIDELINES: Any equivalent combination of education and experience that provides the applicant with the knowledge, skills, and abilities to perform the job is acceptable. A typical way to obtain knowledge and abilities would be: EDUCATION Bachelor’s degree in computer science, engineering, or a related field (Master's degree preferred). TYPE AND EXPERIENCE In-depth knowledge of cloud platforms, such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP). Experience in DevOps, CI/CD, IaC, GitHub Actions, other Source Control, etc. Experience and hands-on with databases (SQL, PostgreSQL) Strong understanding of cloud architecture principles, including scalability, availability, and security. Experience with infrastructure-as-code tools, such as Terraform or CloudFormation. Proficiency in scripting and automation using languages like Python, PowerShell, or Bash. Profound knowledge and hands-on experience in .NET, Core, MVC Knowledge of networking concepts, including routing, load balancing, and VPN. Familiarity with containerization technologies, such as Docker and Kubernetes. Excellent problem-solving and troubleshooting skills. Strong communication and collaboration abilities. Willingness to be proactive & innovative in applying modern technology to solve complex business/technical problems. Willingness to grow personally and professionally in a results-oriented environment. PREFERRED QUALIFICATIONS Cloud certifications, such as AWS Certified Solutions Architect, Azure Solutions Architect, or Google Cloud Certified - Professional Cloud Architect. Experience with DevOps practices and tools, including CI/CD pipelines and configuration management. Experience in leading a team of developers, QA, SDETs Knowledge of data management and analytics technologies, such as Apache Kafka, Spark, or Hadoop. Familiarity with the Agile mindset and principles is a plus SPECIFIC INTERPERSONAL SKILLS Ability to communicate with all levels of management and multiple business units. Strong bias for action; ability to juggle multiple priorities and create a sense of urgency in a fast-paced, dynamic environment. Successful track record in working closely with technical teams to deliver on aggressive schedules. Experience managing release cycles. Knowledge of information technologies, including, but not limited to, databases, application software, mobile platforms, cloud infrastructure and IT infrastructure hardware.
Job Title
Senior Data Engineer