Job Title

Job DescriptionJob Title – Senior AI DeveloperLocations - Hyderabad, IndiaAbout K3-InnovationsK3-Innovations, Inc. is building a cutting-edge, AI-driven SaaS platform that automates criticalworkflows in the biopharma industry. We are expanding our team with an AI RAG Engineer who willhelp us design and optimize retrieval-augmented generation (RAG) pipelines for knowledgeworkflows.This role combines deep expertise in database design, vector search optimization, backendarchitecture, and LLM (Large Language Model) integration. You will play a key role in building ascalable AI platform, bridging structured and unstructured biopharma data with next-generation AI.If you're passionate about building intelligent retrieval systems, fine-tuning prompt pipelines, andoptimizing LLM-based applications for real-world datasets, we want to hear from you!Key Responsibilities1. RAG Pipeline Design and Optimization (Priority #1) Architect and implement retrieval-augmented generation pipelines integrating documentretrieval and LLM response generation. Design and maintain knowledge bases and vector stores using tools like FAISS, Weaviate, orPostgreSQL PGVector. Optimize retrieval mechanisms (chunking, indexing strategies, reranking) to maximizeresponse accuracy and efficiency. Integrate context-aware querying from structured (Postgres) and unstructured (text/PDF)sources.2. Database and Embedding Management Design relational schemas to support knowledge base metadata and chunk-level indexing. Manage embeddings pipelines using open-source models (e.g., HuggingFace sentencetransformers) or custom embedding services. Optimize large-scale vector search performance (indexing, sharding, partitioning).3. LLM and Prompt Engineering Develop prompt engineering strategies for retrieval-augmented LLM pipelines. Experiment with prompt chaining, memory-augmented generation, and adaptive promptingtechniques. Fine-tune lightweight LLMs or integrate APIs from OpenAI, Anthropic, or open-sourcemodels (e.g., LlamaIndex, LangChain).4. Backend API and Workflow Orchestration Build scalable, secure backend services (FastAPI/Flask) to serve RAG outputs to applications. Design orchestration workflows integrating retrieval, generation, reranking, and responsestreaming. Implement system monitoring for LLM-based applications using observability tools(Prometheus, OpenTelemetry).5. Collaboration and Platform Ownership Work closely with platform architects, AI scientists, and domain experts to evolve theknowledge workflows. Take ownership from system design to model integration and continuous improvement ofRAG performance.Required SkillsAI RAG Engineering (Most Critical) Knowledge Retrieval:o Experience building RAG architectures in production environments.o Expertise with vector stores (e.g., FAISS, Weaviate, Pinecone, PGVector).o Experience with embedding models and retrieval optimization strategies. Prompt Engineering:o Deep understanding of prompt construction for factuality, context augmentation,and reasoning.o Familiarity with frameworks like LangChain, LlamaIndex, or Haystack.Database and Backend Development (Essential) PostgreSQL Expertise:o Strong proficiency in relational and vector extension design (PGVector preferred).o SQL optimization, indexing strategies for large datasets. Python Development:o Experience building backend services using FastAPI or Flask.o Proficiency with async programming and API integrations.Observability and DevOps (Supportive) System monitoring for AI workflows using Prometheus, Grafana, OpenTelemetry. Familiarity with Docker, Kubernetes-based deployment pipelines.Preferred Experience (Bonus but not Required) Working with large-scale scientific or healthcare datasets. Exposure to clinical standards like SDTM, ADaM (advantageous for biopharma workflows). Experience integrating domain-specific ontologies into retrieval systems. Familiarity with fine-tuning LLMs on private knowledge bases.What We’re Looking For AI Problem Solver: You are excited by combining retrieval, reasoning, and generativecapabilities to solve real-world problems. Backend and Data Specialist: You understand database performance and scalablearchitectures for retrieval and serving. Builder's Mindset: You thrive in dynamic, evolving environments where you can architectand implement end-to-end solutions.What We Offer Meaningful Impact: Build AI systems that accelerate workflows in the critical biopharmaspace. Technical Growth: Deepen your expertise in retrieval-augmented generation and scalable AIsystems. Remote Flexibility: Results-driven work culture with location flexibility. Competitive Compensation: Attractive salary, benefits, and learning opportunities.Join UsHelp us revolutionize how biopharma manages and accesses knowledge through the power of AI.