Job OverviewWe are seeking a seasoned Data Engineer to lead the design and implementation of modern data pipelines. In this role, you will integrate advanced machine learning workflows and enable scalable solutions across Snowflake and AWS environments.The successful candidate will collaborate with cross-functional teams to deliver high-impact projects, including initiatives that leverage large language models (LLMs) for 'talk to data' applications.Key ResponsibilitiesData Pipeline Development: Build and optimize ETL/ELT pipelines to move and transform data across Snowflake and AWS.LLM Integration: Partner with ML engineers to design workflows that connect structured data with LLM applications.Cloud Deployment: Architect and manage scalable data solutions using AWS services (Glue, Lambda, S3, Redshift, etc.).Python Engineering: Write clean, modular Python code for data ingestion, transformation, and orchestration.Data Governance: Ensure data quality, lineage, and security across all pipelines and integrations.Collaboration: Work closely with client stakeholders, ML engineers, and product teams to align technical solutions with business needs.Innovation: Explore emerging tools and frameworks to enhance 'talk to data' capabilities and improve efficiency.Required Skills & QualificationsStrong proficiency in Snowflake for data engineering and analytics.Hands-on experience with Python for data workflows and automation.Proven expertise in AWS cloud services for data engineering.Exposure to LLM development and integration into data pipelines.5+ years of experience in data engineering or related roles.Ability to operate independently and lead technical initiatives in client environments.BenefitsThis role offers the opportunity to work on cutting-edge projects, leveraging the latest technologies and innovations in data engineering.OthersThe ideal candidate will be passionate about delivering high-quality results, collaborating effectively with teams, and staying up-to-date with industry trends and developments.
Job Title
Data Engineering Lead