Job Title

Product Architect - AI/MLLocation: India/OffshoreExperience: 12-15 years (Minimum 6-7 years in AI/ML Product Architecture)Location: -Pune preferred / Hyderabad (4 Days WFO)Role OverviewDefine and drive the technical product vision for enterprise AI/ML platforms in healthcare,translating business requirements into scalable architectures while ensuring deliveryexcellence and long-term product sustainability. This role requires hands-on leadership,flexible collaboration across time zones, and the ability to mentor engineering teams.Product & Technical Strategy• Architect end-to-end product solutions for processing clinical records, claims, andhealthcare documentation• Design hybrid Azure/on-premises architectures supporting multi-tenant SaaS andenterprise deployment models• Establish product architecture principles, design patterns, and technology stackdecisions• Evaluate build-vs-buy decisions for AI capabilities, Drive technical feasibilityassessments and rapid prototyping for new product features• Own non-functional requirements: performance, security, compliance (HIPAA),scalability, reliability• Present architectural proposals and technical roadmaps to leadership through clearpresentations and documentation AI/ML Product Engineering• Design and implement fine-tuning pipelines for domain-specific LLMs (e.g. Llama,Mistral, Phi-3) on medical datasets• Architect MLOps frameworks enabling continuous model improvement: training,evaluation, deployment, monitoring• Build “built-in-intelligence-products” using advanced AI models.• Implement distributed training infrastructure on Azure ML with GPU optimization(RTX5090/4090/A100/H100 clusters)• Create model evaluation frameworks with domain-specific metrics and qualitybenchmarks• Develop synthetic data generation capabilities for model training and testing• Establish model versioning, A/B testing, and rollback strategies for productiondeployments Platform & Infrastructure• Design microservices architectures with Azure Kubernetes Service, Service Bus, EventHubs for event-driven workflows• Build scalable data pipelines using Azure Data Factory, Synapse Analytics, Databricks forhigh-volume processing• Implement CI/CD automation through Azure DevOps with comprehensive testing anddeployment gates• Architect observability solutions: monitoring, logging, alerting, performance analytics• Design hybrid cloud integration patterns connecting Azure services with on-premisessystems• Manage data architecture: Azure SQL, Cosmos DB, blob storage, data lakes with lifecyclepolicies Delivery Excellence & Hands-On Leadership• Lead proof-of-concept execution from inception to production-ready solutions withindefined timelines• Conduct rigorous code reviews ensuring adherence to standards, performanceoptimization, and maintainability• Roll up sleeves for critical implementation work: debugging production issues, optimizingmodel performance, refactoring complex modules• Deliver technical demos to internal stakeholders and customers showcasing productcapabilities• Establish engineering excellence standards: code quality, testing frameworks, peerreviews, documentation• Create comprehensive technical documentation: architecture decision records, APIcontracts, deployment guides• Identify and systematically address technical debt across AI models, infrastructure, andcodebase Team Development & Collaboration• Mentor and develop junior engineers and fresh graduates through pair programming, andtechnical guidance• Review and provide constructive feedback on designs, code, and technical approachesfrom team members• Foster engineering culture emphasizing quality, innovation, and continuous learning• Collaborate with US-based teams requiring flexibility for meetings during early morning orlate evening IST hours• Bridge communication between offshore development teams and US-basedproduct/business stakeholders • Translate business requirements from US teams intoactionable technical tasks for India-based engineers• Participate in cross-timezone planning, sprint reviews, and architecture discussionsRequired Qualifications • [Non Negotiable] Expert Python development with PyTorch,Transformers, production ML frameworks • [Non Negotiable] Comfortable handlingNVIDIA/CUDA variants and their inner workings.• [Non Negotiable] Proven experience fine-tuning LLMs and deploying custom models inregulated environments • [Non Negotiable] Track record of shipping production AI productswith measurable business impact• [Non Negotiable] Core Software Engineering skills. AI/ ML expertise, DevOps.• [Non Negotiable] Flexibility to work with US hours overlap Key Competencie• Hands-on technical leadership and a user-centric approach to technical architecture• Ownership mindset with accountability for outcomes and the ability to balanceinnovation with pragmatic engineering• Effective communicator capable of engaging both technical and non-technical audiences• Comfortable operating at multiple levels: strategy, architecture, and implementation