Job Title

We are looking for a passionate Senior Data Engineer to join our team at Compass Digital. You will design, develop, and maintain cutting-edge data products and AI solutions, focusing on making difficult-to-access data sources available through web scraping and document scanning. Collaborating with Data Scientists, Analytics Engineers, Front-End Engineers, ML Engineers, and AI Engineers, you will build cloud-native backend systems and infrastructure for new AI-powered applications. Your work will lay the foundations for a new product delivering Data Analytics and AI capabilities.Now, if you were to come on board as our Senior Data Engineer, wed ask you to do the following for us:Design, build, and maintain scalable, Playwright-based web scraping systems to extract data from dynamic and complex web sourcesStay current with best practices in web scraping, anti-bot mitigation, headless browser automation, and AI infrastructureCollaborate with cross-functional teams to define, design, and ship new features;Architect efficient, reusable backends for scraping and AI workflows in the cloudWrite clean, well-documented, and maintainable code following best practices;Conduct code reviews, provide constructive feedback and mentor junior team members;Staying up-to-date with emerging AI technologies and industry trends to drive continuous improvementEnsure data quality, resilience, and compliance across scraping processesWork in a dynamic, collaborative, progressive, and high-performing teamInteractions with multiple cross-functional teams, exposure to many components of modern data technology Think you have what it takes to be our Senior Data Engineer? Were committed to hiring the best talent for the role. Heres how well know youll be successful in the role:Bachelor's degree in a STEM field or equivalent experienceStrong experience with Large Language Models (LLMs)2+ years of hands-on experience in developing AI and data productsStrong knowledge of Python and scraping frameworks/libraries (e.g., Playwright, BeautifulSoup, Requests)Strong cloud engineering skills with experience taking AI ideas to productionFamiliarity with proxy rotation, CAPTCHA solving, and session management in automated scrapingFamiliarity with RESTful APIsKnowledge of version control systems such as Git and agile development methodologiesExcellent problem-solving skills, attention to detail, and ability to work independently or within a teamExcellent written and verbal communication skills, with the ability to convey complex concepts to non-technical users