Job Title: Data Engineer (AWS QuickSight, Glue, PySpark)Location: NoidaJob Summary: We are seeking a skilled Data Engineer with 4-5 years of experience to design, build, and maintain scalable data pipelines and analytics solutions within the AWS cloud environment. The ideal candidate will leverage AWS Glue, PySpark, and QuickSight to deliver robust data integration, transformation, and visualization capabilities. This role is critical in supporting business intelligence, analytics, and reporting needs across the organization.Key Responsibilities:Design, develop, and maintain data pipelines using AWS Glue, PySpark, and related AWS services to extract, transform, and load (ETL) data from diverse sourcesBuild and optimize data warehouse/data lake infrastructure on AWS, ensuring efficient data storage, processing, and retrievalDevelop and manage ETL processes to source data from various systems, including databases, APIs, and file storage, and create unified data models for analytics and reportingImplement and maintain business intelligence dashboards using Amazon QuickSight, enabling stakeholders to derive actionable insightsCollaborate with cross-functional teams (business analysts, data scientists, product managers) to understand requirements and deliver scalable data solutionsEnsure data quality, integrity, and security throughout the data lifecycle, implementing best practices for governance and compliance5.Support self-service analytics by empowering internal users to access and analyze data through QuickSight and other reporting tools1.Troubleshoot and resolve data pipeline issues, optimizing performance and reliability as neededRequired Skills & Qualifications:Proficiency in AWS cloud services: AWS Glue, QuickSight, S3, Lambda, Athena, Redshift, EMR, and related technologiesStrong experience with PySpark for large-scale data processing and transformationExpertise in SQL and data modeling for relational and non-relational databasesExperience building and optimizing ETL pipelines and data integration workflowsFamiliarity with business intelligence and visualization tools, especially Amazon QuickSightKnowledge of data governance, security, and compliance best practices5.Strong programming skills in Python; experience with automation and scriptingAbility to work collaboratively in agile environments and manage multiple priorities effectivelyExcellent problem-solving and communication skills.Preferred Qualifications:AWS certification (e.g., AWS Certified Data Analytics – Specialty, AWS Certified Developer) Good to have skills - understanding of machine learning , deep learning and Generative AI concepts, Regression, Classification, Predictive modeling, Clustering, Deep Learning
Job Title
Data Engineer