Job Title

Job Title: GCP Data Engineer Job Description: Required Skillset: Data Integration and Data Warehouse experience, Google BigQuery (Including BQ query standards, partitioning/clustering, data-model) , Python, SQL, Cloud Composer (Airflow DAG), and any Data Quality check tool or custom knowledge. The ideal candidate will have a strong background in data with a deep understanding of Big Query, Data Integration, Python and SQL. Key Responsibilities: Develop, implement, and maintain scalable data pipelines and ETL processes. Design and optimize BigQuery data structures and queries for high performance. Integrate various data sources Write efficient SQL queries to extract, manipulate, and analyze large datasets. Ensure data quality, governance, and security in collaboration with stakeholders. Work closely with Data Analysts, Scientists, and Engineers to provide clean and well-structured data. Automate workflows using Apache Airflow and monitor data pipelines. Required Skills & Qualifications: 7+ years of experience in data engineering or a related field. Proficiency in Python for data manipulation and automation. Strong understanding of API Backend Integration and data extraction techniques. Hands-on experience with Google BigQuery and SQL optimization Familiarity with ETL/ELT processes and pipeline development. Strong analytical and problem-solving skills. Excellent communication and collaboration skills. Create custom Read and Write connectors using Python framework Good understanding of error logging Experience in Airflow (Create DAGs, configure variables, scheduling) Worked in DevSecOps (CI/CD) environment Data Quality – Technical and business quality checks Interact with platform leads and third-party application leads to understand and analyze various interfaces and data integration needs to create technical user stories. Contribute to the creation of technical design and estimation for user stories, and review with the EAC team and Product Owner Conduct and participate in code review sessions for team deliverables Guide team members and involve in development and unit testing Work with business users for UAT and assist QA team with defect fixing. Help troubleshoot critical issues in development, staging, or production environments Nice to Have/Optional Skill Set Knowledge of Ascend for data pipeline automation.