At Analytics Saves at Work, we are Looking for a data engineer for one of our client to play a crucial role in enabling organization to effectively leverage data for decision-making, insights generation and business growth.Job Responsibilities • The Ideal candidate will be responsible for Designing, Developing and maintaining data pipelines.• Serving as a core member of an agile team that drives user story analysis and elaboration, designs and develops responsive web applications using the best engineering practices• You will closely work with data scientists, analysts and other partners to ensure the flawless flow of data.• You will be Building and optimize reports for analytical and business purpose.• Monitor and solve data pipelines issues to ensure smooth operation.• Implementing data quality checks and validation process to ensure the accuracy completeness and consistency of data• Implementing data governance policies, access controls , and security measures to protect critical data and ensure compliance.• Developing deep understanding of integrations with other systems and platforms within the supported domains.• Bring a culture of innovation, ideas, and continuous improvement.• Challenging status quo, demonstrate risk taking, and implement creative ideas• Lead your own time and work well both independently and as part of a team.• Adopt emerging standards while promoting best practices and consistent framework usage.• Work with Product Owners to define requirements for new features and plan increments of work.Minimum Qualifications• BS or MS degree in computer science, computer engineering, or other technical subject area or equivalent 3-12years of work experience• At least 5 years of hands-on experience with SQL, including schema design, query optimization and performance tuning.• Experience with distributed computing frameworks like Hadoop, Hive, Spark for processing large scale data sets.• Proficiency in any of the programming language python, pyspark for building data pipeline and automation scripts.• Understanding of cloud computing and exposure to any cloud GCP, AWS or Azure.• knowledge of CICD, GIT commands and deployment process.• Strong analytical and problem-solving skills, with the ability to troubleshoot complex data issues and optimize data processing workflows• Excellent communication and collaboration skills.
Job Title
Data Engineer