Job Title

AI Automation Test Engineer (Python & GenAI/LLM) 6-12yrs HyderabadJob Summary : Test generative AI solutions on AWS, validating LLMs, RAG, prompts, and agentic workflows with n8n and Python libraries like deepchecks, Ragas and LangChain.Key Requirements (8 Points) : Test LLM outputs on AWS Bedrock using boto3. Validate fine-tuned LLMs on AWS SageMaker with deepchecks. Verify langchain prompts in AWS environments. Test RAG pipelines with AWS OpenSearch and langchain. Validate AI agents (crewai/autogen) on AWS Lambda/equivalent Test n8n agentic workflows (e.g.,n8n.io/workflows/6270 ). Ensure deployment stability on Amazon ECS/EKS with Docker. Monitor performance with Amazon CloudWatch and wandb.Must-Have Skills : 2 years testing GenAI/LLMs using Python 4+ years’ experience in QA Automation Expertise in AWS Bedrock, SageMaker, Lambda, boto3. Proficiency in deepchecks, langchain, crewai, autogen, wandb. Experience testing n8n workflows, RAG, prompts.