Qualifications: 4+ years of experience in ETL & Data Warehousing Excellent leadership & communication skills Experience in developing Data Engineering solutions using Airflow, GCP BigQuery, Cloud Storage, Dataflow, Cloud Functions, Pub/Sub, Cloud Run, etc. Built solution automations using any of the above ETL tools Executed at least 2 GCP Cloud Data Warehousing projects Worked on at least 2 projects using Agile/SAFe methodology Mid-level experience in PySpark and Teradata Working experience on any DevOps tools like GitHub, Jenkins, Cloud Native Familiarity with semi-structured data formats like JSON, Parquet, XML Experience in writing complex SQL queries for data analysis and extraction In-depth understanding of Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping Education: B.Tech. / B.E. in Computer Science or related field Certifications: Google Cloud Professional Data Engineer Certification Roles & Responsibilities: Analyze different source systems, profile data, understand, document & fix data quality issues Gather requirements and business process knowledge to transform data as per user needs Write complex SQLs to extract & format source data for ETL/data pipeline Create design documents, Source to Target Mapping documents and deployment/migration support docs Design, Develop, and Test ETL/Data pipelines Design & build metadata-based frameworks for data pipelines Write Unit Test cases, execute testing, and document results Deploy ETL/Data pipelines Use DevOps tools to version control and deploy code across environments Support during troubleshooting, debugging, defect fixes, business requests, environment migrations, and ad hoc tasks Provide production support, enhancements, and bug fixes Work with business and technology stakeholders to handle EDW incidents/problems Apply ITIL concepts for incident management and documentation Perform data cleaning, transformation, and validation to ensure accuracy and consistency Stay updated on industry best practices and emerging GCP technologies
Job Title
GCP Data Engineer