Job Title: Senior Data Engineer – DatabricksJob Type: 6-month contract to permanentLocation: Vancouver, BC (Hybrid, 3 days in-office)Hours per week: 40 hours per weekRate: $60/hr Inc. ($115K to $120K when it converts to permanent)OverviewOur client is embarking on a transformative data journey to consolidate their data infrastructure into a unified Databricks Lakehouse platform. As a Senior Data Engineer, you will lead the technical implementation of their Databricks migration, establishing foundational data architecture, and mentoring team members to build a scalable, reliable data ecosystem. This role is critical for designing and implementing a comprehensive data strategy that drives business value through advanced analytics and AI capabilities.ResponsibilitiesDesign and implement a medallion architecture (bronze, silver, gold) within Databricks to support data transformation, quality, and accessibilityDevelop robust ETL/ELT pipelines to ingest data from various sources, including the SQUARE Point of Sale (POS) system and our ERP (INforce)Establish governance frameworks using Unity Catalog to ensure data security, compliance, and proper access controlsCollaborate with business stakeholders to standardize business definitions and logic through a well-designed semantic layerMentor and upskill team members on Databricks technologies, best practices, and modern data engineering techniquesOptimize data pipelines for performance and cost efficiency in cloud environmentsImplement data quality monitoring and testing frameworks to ensure reliable analyticsEnable a single source of truth across the organization by consolidating disparate data sources into a unified Lakehouse platformAccelerate business decision-making through standardized metrics and efficient data processingEstablish a foundation for advanced analytics, AI/ML capabilities, and forecastingBuild a scalable data architecture that supports the company’s long-term data strategyCreate a culture of data excellence by mentoring team members and establishing best practicesDrive the successful implementation of multi-phase data migration from legacy systems to modern cloud architectureQualifications:5+ years of experience in data engineering, with at least 2 years of hands-on experience with DatabricksStrong proficiency in Python and SQL for data transformation and pipeline developmentExperience implementing medallion architecture and Delta Lake in production environmentsPractical knowledge of Unity Catalog and data governance frameworksExperience with cloud platforms, preferably AWSDemonstrated ability to mentor junior team members and communicate technical concepts effectivelyExperience with data modeling and implementing semantic layersFamiliarity with data visualization tools (Power BI preferred)Experience migrating data from on-premises systems to cloud environmentsDatabricks certification (e.g., Databricks Certified Data Engineer) is a plus
Job Title
Senior Data Engineer