Job Title

Insight Global is seeking a Data Engineer to join a large retail client on a remote 6-month contract. The data engineering team builds and maintains the data infrastructure that powers analytics, reporting, and data-driven decision making across the companys digital platforms, retail operations, and business units. They work with cross-functional agile squads to develop reliable data pipelines, improve data quality, build self-serve analytics tools for our business stakeholders, and ensure timely access to accurate data for our analysts and data scientists.As a Data Engineer, you'll join a large retail client on their Data and Analytics team which play a key role in developing reporting and analytics for key business units. The data engineer will join the Data Platform Squad which is currently supporting the generation of a large data lake to host guest data. This data lake will store guest data from various sources such as Salesforce, social media campaigns on Facebook, tik tok, etc, and clickstream data from their website. On the day to day, the Data Engineer will take data from various sources, clean and ingest it to get onto the Azure data platforms in order to produce data models for the business stakeholders. They will be designing and implementing complex data pipelines from different internal/external sources using the Microsoft stack and Azure BI services. Leveraging Databricks Unity Catalog, they will also manage and govern machine learning models and associated data assets. There will also be close collaboration with data architects to transform requirements into code and prepare database structures needed for reporting, analytics, and visualizations. They will also create recommendations to advise on optimal data strategies for data ingestion, integration, and visualization to improve code performance and query optimization to meet demanding data analytics and visualization needs. Must Haves:5+ years of technical development experience on Microsoft Azure, with an expertise in DatabricksExtensive experience with Azure Databricks, Azure Data factory and Unity catalog (including strong experience creating tables, doing access control, partitioning)Experience in writing and optimizing complex SQLs, and scripting in python and working with pyspark Experience working with digital customer marketing data (clickstream data), aka did that click lead to a purchase did it not), AND social media/ paid media data, aka did that campaign engagement lead to a purchase or did it notExperience sending data to and pulling data from SalesforceComprehensive understanding of ETL and ELT processes with the ability to implement end-to-end solution flows for complex requirements.Strong communication and collaboration skills Plusses: Experience w/retail and/or sporting goods industry experience.Machine Learning Predictive Analysis Experience (for example with SparkMLib)Experience with Access Control Lists (ACLs) for Data Security