Job Title

Job Description A fortune 100 client is seeking a highly skilled and experienced Senior Data Engineer to support an enterprise-level migration of the metadata layer from Presto to Unity Catalog within the Databricks Lakehouse Platform. This role requires deep expertise in Databricks, Spark, and modern data architecture, with a strong focus on data governance, performance optimization, and scalable pipeline development. The two additional data engineers will join the client's 2 current team members and will work on an individual basis to complete the migration effort. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: Skills and Requirements u2022u20038+ years experience as a Data Engineer with a minimum 5 years of experiences in Azure tool stack (Databricks, ADF, Synapse Analytics) u2022u2003Strong expertise in writing complex SQL and transformations u2022u2003Ability to write, review and examine code written in Python and PySpark u2022u2003Proficient in Devops CICD u2022u2003Expertise in RDBMS u2022u2003Fundamental knowledge of Data Warehousing concepts u2022u2003SQL and SQL tuning within Data Lake (Delta Format) u2022u2003Azure services: azure functions, event grid u2022u2003Tableau & PowerBI u2022u2003Prior PepsiCo experience u2022u2003Databricks certification u2022u2003Local to HYD