Job Title

About the RoleCARS24 is seeking an experienced Senior Engineer/Assistant Engineering Manager to join our AI Team. This is not a data science or AI research role – we're looking for a strong platform engineer who can architect, build, and lead the development of robust, scalable AI infrastructure that powers our intelligent applications at scale.You'll be responsible for building the foundational AI platforms and services that enable our product teams to rapidly deploy and operate AI-powered features. This role requires deep engineering expertise combined with hands-on experience in modern AI/ML infrastructure.What You'll DoDesign and build scalable AI platforms and services that support multiple AI/ML use cases across CARS24Architect and implement production-grade AI agent systems, including RAG pipelines, vector databases, and LLM orchestration frameworksLead the development of synchronous and asynchronous AI service APIs with focus on reliability, performance, and cost optimizationBuild streaming infrastructure for real-time LLM interactions using WebSockets and server-sent eventsEstablish engineering best practices, code standards, and architectural patterns for the AI platform teamMentor junior engineers and contribute to technical decision-making as we scale our AI capabilitiesPartner with ML engineers and product teams to translate AI/ML models into production-ready servicesOwn end-to-end delivery of critical AI platform components from design through deployment and operationsWhat We're Looking ForCore Engineering Expertise:Python Expert: Deep proficiency in Python with strong knowledge of async programming, type systems, and performance optimizationJava/Spring Advanced: Strong working knowledge of Java and Spring Boot for building enterprise-grade microservices5-6 years of hands-on software engineering experience with a track record of building production systems at scaleAI Platform & Infrastructure:Solid understanding of AI agent architectures and orchestration frameworks (LangChain, LlamaIndex, or similar)Experience implementing RAG (Retrieval-Augmented Generation) systems in productionHands-on experience with vector databases (Pinecone, Weaviate, Qdrant, ChromaDB, or similar)Knowledge of LLM APIs, prompt engineering, and managing model inference at scaleExperience building both synchronous and asynchronous AI service architecturesUnderstanding of LLM streaming patterns using WebSockets, SSE, or gRPC streamingSoftware Engineering Fundamentals:Strong system design skills with ability to architect scalable, distributed systemsExperience with cloud platforms (AWS/GCP/Azure) and containerization (Docker, Kubernetes)Proficiency with APIs, microservices, message queues, and event-driven architecturesSolid understanding of database design, caching strategies, and performance optimizationExperience with CI/CD pipelines, monitoring, and observability toolsStrong Plus/Nice to HavePrior experience building AI platforms or AI-powered services in a product companyExperience leading or mentoring engineering teamsHands-on experience with model serving frameworks (TensorFlow Serving, TorchServe, Triton, etc.)Knowledge of MLOps practices and tools (MLflow, Weights & Biases, Kubeflow)Experience with real-time data processing and streaming platforms (Kafka, Kinesis)Familiarity with embedding models, semantic search, and information retrieval systemsPrevious work in automotive, e-commerce, or marketplace platformsWhat Success Looks LikeBuild and deploy production-ready AI platforms that serve millions of users reliablyEstablish technical standards that accelerate AI feature development across teamsCreate reusable AI infrastructure components that reduce time-to-market for new AI capabilitiesLead by example in code quality, system design, and engineering excellenceWhy Join CARS24's AI TeamWork on cutting-edge AI infrastructure that directly impacts customer experienceShape the technical direction of AI platforms at a rapidly growing unicornCollaborate with talented engineers, data scientists, and product leadersOpportunity to grow into engineering leadership roles as the team scales