Position: AWS Data EngineeringLocation: Toronto, On HybridKey Responsibilities:Design and implement scalable ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, and other AWS services.Integrate structured and unstructured data from diverse sources into data lakes and warehouses (e.g., S3, Redshift, RDS, Athena).Build and maintain cloud infrastructure for data analytics platforms using Terraform, CloudFormation, or similar IaC tools.Develop reusable frameworks and automation scripts to streamline data operations.Collaborate with Data engineers, data scientists and analysts to deliver high-quality platform for Loading, reporting and machine learning.Optimize data models and queries for performance and scalability.Monitor data pipelines and troubleshoot issues to ensure reliability and data integrity.Implement Cloud development Kit, CI/CD pipelines for data engineering workflows using GitLab, Bitbucket, Jenkins, or GitHub Actions.Ensure compliance with data governance and security best practices.Implement access controls and encryption for sensitive data.Proficiency in Python, SQL, and PySpark.Hands-on experience with AWS services: S3, Glue, Lambda, Redshift, RDS, Athena, Step Functions.Experience with orchestration tools like Apache Airflow or MWAA.Familiarity with DevOps tools and practices (CDK,CI/CD, Git, Terraform).Strong understanding of data modeling, warehousing, and ETL processes.Preferred Skills:Experience with big data tools (Spark, Hive, Kafka Python, Typescript).Knowledge of containerization (Docker, Kubernetes).Familiarity with data visualization tools ( Power BI).AWS certifications (e.g., AWS Certified Data Analytics Specialty).RegardsPatrick FernandezTalent Acquisition Group - Strategic Recruitment Manager
Job Title
AWS Data Engineering