Job Title

VTRAC Consulting CorporationIntelligent SolutionsThank you for applying to VTRAC opportunities. Please e-mail your resume as an MS-WORD document in confidence Subject: URGENT - Data Engineer (AWS, Ruby, Python, Apache Spark), Attention: or call: (647) 254-0904Position #: 251179Position: URGENT - Data Engineer (AWS, Ruby, Python, Apache Spark)Position Type: ContractNo. of Positions: 1Location: Remote (Nova Scotia)Description:An exciting opportunity for a Data Engineer to join a collaborative environment and help build and maintain the data infrastructure. The successful candidate will be responsible for designing, building, and maintaining data systems, including data pipelines, data warehouses, and data lakes. You will work closely with data architects, data scientists, and other stakeholders to ensure that the entire data systems meet the needs of our business. This is a fully remote opportunity with the potential to become a permanent position.Key Responsibilities:Design, build, and maintain large-scale data systems.Design and implement data warehouses using tools such as Amazon Redshift, Google BigQuery, and Snowflake.Develop and maintain data pipelines using tools such as Apache Beam, Apache Spark, and AWS Glue.Develop and maintain data lakes using tools such as Apache Hadoop, Apache Spark, and Amazon S3.Work with data architects to design and implement data models and data architectures.Collaborate with data scientists to develop and deploy machine learning models and data products.Design and implement scalable automated testing solutions using Ruby/Selenium-based frameworks.Ensure data quality and integrity by developing and implementing data validation and data cleansing processes.Collaborate with other teams to ensure that data systems meet the business's needs.Stay up-to-date with new technologies and trends in data engineering and make recommendations for adoption.Qualifications:5+ years of experience in data engineering or a related field5+ years of experience with programming languages such as Python, Java, and Scala3+ years of experience with data modeling and data architecture3+ years of experience with data engineering tools such as Apache Beam, Apache Spark, AWS Glue, Amazon Redshift, Google BigQuery, and SnowflakeProficient in Ruby on Rails framework.Strong experience with data warehousing and data lakesStrong experience with data validation and data cleansingStrong collaboration and communication skillsBachelor's degree in Computer Science, Engineering, or a related fieldNice to Have:Experience with machine learning and data scienceExperience with cloud-based data platforms such as AWS, GCP, or AzureExperience with containerization using Docker and KubernetesExperience with agile development methodologies such as Scrum or KanbanExperience with data governance and data securityWe thank all candidates in advance. Only selected candidates for interviews will be contacted. For other exciting opportunities, please visit us at . VTRAC is an equal-opportunity employer.Toronto. Houston. New York. Palo Alto.