Skip to Main Content

Job Title


Senior AI Backend Engineer


Company : Talentmatics


Location : Hyderabad, Telangana


Created : 2026-03-21


Job Type : Full Time


Job Description

We are looking for a Senior AI Backend Engineer to build and scale the core infrastructure powering next-generation AI products. This is a high-impact role where you will work at the intersection of backend engineering, machine learning systems, and cloud infrastructure.If you’re passionate about building scalable AI systems, optimizing model performance, and working with cutting-edge technologies like LLMs and real-time data pipelines — we’d love to connect!Key ResponsibilitiesDesign and develop scalable backend services for AI-driven applicationsBuild and maintain APIs for model inference (LLMs, NLP, Computer Vision, Recommendation Systems)Deploy and manage ML models in production environmentsDevelop data pipelines for training, evaluation, and real-time inferenceOptimize systems for low-latency and high-throughput workloadsImplement monitoring, logging, and observability for AI servicesEnsure system security, reliability, and scalabilityCollaborate with ML engineers to productionize modelsWork with DevOps teams on cloud infrastructure and CI/CD pipelinesRequired Skills & Experience7–8 years of backend development experienceStrong proficiency in Python (preferred) or Node.js / GoExperience building RESTful APIs / GraphQL servicesHands-on experience with ML frameworks like TensorFlow / PyTorchExperience deploying ML models into productionFamiliarity with cloud platforms (AWS / GCP / Azure)Strong understanding of SQL & NoSQL databasesExperience with Docker & containerizationSolid knowledge of distributed systems & microservices architecturePreferred QualificationsExperience with LLM integration & prompt engineeringFamiliarity with model serving tools (FastAPI, TorchServe, Triton)Knowledge of vector databases (Pinecone, Weaviate, FAISS)Experience with streaming systems (Kafka, Pub/Sub)Exposure to KubernetesUnderstanding of MLOps practices and toolsPrior experience in a startup or high-growth environment