About the RoleWe’re building a next-generation Data Analytics Engine that transforms raw market and historical data into actionable intelligence for the electronics supply chain industry. Our platform ingests, processes, and analyzes high-volume data across suppliers, parts, and trends — powering real-time insights and ML-driven applications. We are looking for ahighly experienced Lead or Staff Data Engineerto help us shape and scale our core data infrastructure. The ideal candidate brings a proven track record of designing and delivering scalable ETL pipelines and real-time data systems inAWS and open-source environments(e.g., Airflow, Spark, Kafka). This role requires deep technical ownership and leadership to enhance our architecture, implement best practices, and guide junior engineers.Key ResponsibilitiesDesign, implement, and optimizescalable ETL pipelinesfor billions of records usingAWS-native tools(Glue, Step Functions, S3, PostgreSQL). Migrate and evolve existing pipelines towardopen-source orchestration toolssuch asApache Airflow and Kafka . Leaddata lake and data warehouse architecture designfor analytics and ML workflows. Own and maintainCI/CD workflowsensuring reliability, observability, and deployment automation. Implementdata validation, schema evolution, anomaly detection, and data quality checks . Contribute toInfrastructure as Code (Terraform, AWS CDK)for reproducible deployments. Providetechnical mentorship , make architectural decisions, and establish best practices.Required Qualifications8+ yearsof experience as a Data Engineer or similar role with production ownership. Expertise inAWS tools : Glue, Step Functions, S3, Athena, Lambda. Deep knowledge ofopen-source data stack : Apache Airflow, Spark, Kafka, dbt. StrongPython programmingskills for modular workflows and automation. Expert-levelSQLand experience withPostgreSQL(or similar databases). Experience withCI/CD tools(GitHub Actions, Jenkins, etc.). Familiarity withInfrastructure as Code : Terraform, AWS CDK, or CloudFormation. Ability tomentor engineers and lead architectural decisions .Preferred QualificationsBackground inML/AI pipelines or feature engineering . Experience withserverless technologiesorcontainerized deployments(Docker, Lambda). Familiarity withdata observability tools and alerting systems .EducationBachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related technical field(or equivalent practical experience).What We OfferOpportunity to work onimpactful, real-world problemsin supply chain intelligence. Direct mentorshipfrom experienced engineers and AI product leads. Aflexible, startup-friendly environmentwhere your contributions matter. Competitive compensation and opportunities for career growth.
Job Title
Lead Data Engineer (1 Position)