Job Title: Data Engineer (AWS QuickSight, Glue, PySpark) Location: Noida Job Summary: We are seeking a skilled Data Engineer with 4-5 years of experience to design, build, and maintain scalable data pipelines and analytics solutions within the AWS cloud environment. The ideal candidate will leverage AWS Glue, PySpark, and QuickSight to deliver robust data integration, transformation, and visualization capabilities. This role is critical in supporting business intelligence, analytics, and reporting needs across the organization.Key Responsibilities: Design, develop, and maintain data pipelinesusing AWS Glue, PySpark, and related AWS services to extract, transform, and load (ETL) data from diverse sources Build and optimize data warehouse/data lake infrastructureon AWS, ensuring efficient data storage, processing, and retrieval Develop and manage ETL processesto source data from various systems, including databases, APIs, and file storage, and create unified data models for analytics and reporting Implement and maintain business intelligence dashboardsusing Amazon QuickSight, enabling stakeholders to derive actionable insights Collaborate with cross-functional teams(business analysts, data scientists, product managers) to understand requirements and deliver scalable data solutions Ensure data quality, integrity, and securitythroughout the data lifecycle, implementing best practices for governance and compliance5. Support self-service analyticsby empowering internal users to access and analyze data through QuickSight and other reporting tools1. Troubleshoot and resolve data pipeline issues , optimizing performance and reliability as neededRequired Skills & Qualifications: Proficiency in AWS cloud services:AWS Glue, QuickSight, S3, Lambda, Athena, Redshift, EMR, and related technologies Strong experience with PySparkfor large-scale data processing and transformation Expertise in SQL and data modelingfor relational and non-relational databases Experience building and optimizing ETL pipelinesand data integration workflows Familiarity with business intelligence and visualization tools , especially Amazon QuickSight Knowledge of data governance, security, and compliance best practices 5. Strong programming skills in Python ; experience with automation and scripting Ability to work collaboratively in agile environmentsand manage multiple priorities effectively Excellent problem-solving and communication skills .Preferred Qualifications: AWS certification(e.g., AWS Certified Data Analytics – Specialty, AWS Certified Developer) Good to have skills -understanding of machine learning , deep learning and Generative AI concepts, Regression, Classification, Predictive modeling, Clustering, Deep Learning
Job Title
Data Engineer