About the Role: We are looking for a Gen AI Tester with 4–8 years of experience. This role is remote or hybrid and has a duration of 6 months.Responsibilities:Design and execute test cases for Gen AI applications (LLMs, chatbots, copilots, etc.).Validate AI outputs for relevance, coherence, factual accuracy, and bias.Automate test workflows for APIs, AI pipelines, and model integrations.Perform regression, functional, and exploratory testing of AI features.Work with developers and data scientists to refine prompts and improve model performance.Track defects, performance metrics, and maintain test documentation.Required Skills:Gen AI / LLM Testing (OpenAI, Azure OpenAI, Anthropic, or similar)Prompt Engineering and ValidationPython / Postman / API Testing (REST, JSON)Knowledge of ML workflows and data validationFamiliarity with automation tools (Selenium, PyTest, Robot Framework)Agile & DevOps Environment ExperiencePreferred Skills:Experience testing RAG (Retrieval-Augmented Generation) systemsExposure to AI ethics, hallucination detection, and model evaluation metricsAI-related certifications
Job Title
Gen AI Tester