Job Title

Join to apply for theAI, Data Scientistrole atPFF Join to apply for theAI, Data Scientistrole atPFF Get AI-powered advice on this job and more exclusive features. About PFFPFF is a leading sports analytics company that transforms complex football data into powerful insights. Our exclusive player grades, advanced metrics, and tools fuel winning decisions for NFL and college teams, broadcasters, fantasy players, bettors, and fans alike. About PFFPFF is a leading sports analytics company that transforms complex football data into powerful insights. Our exclusive player grades, advanced metrics, and tools fuel winning decisions for NFL and college teams, broadcasters, fantasy players, bettors, and fans alike.We are seeking an experienced AI Data Scientist with deep expertise in Large Language Models (LLMs) to lead efforts in model evaluation, tracing, optimization, and distillation. You will play a key role in enhancing the performance, reliability, and safety of generative AI systems across our consumer and B2B products including football chatbots, scouting assistants, and fan-facing analytics platforms.What You’ll DoDesign robust evaluation frameworks for LLMs (e.g., hallucination detection, factual accuracy, prompt robustness, calibration). Use model tracing tools (e.g., OpenAI trace logs, LangSmith, Weights & Biases) to analyze model behavior and failure modes. Lead or assist with LLM distillation projects, compressing large foundation models into smaller performant versions fine-tuned on football-specific domains. Create and test structured prompting strategies, build RAG pipelines, and implement safety/guardrails. Curate and synthesize football-specific data and knowledge graphs for fine-tuning, evaluation, and few-shot performance. Deploy dashboards and alerts to monitor drift, toxicity, bias, or degradation in real-world usage. Collaborate with engineers, designers, and product teams to bring LLM-powered features to life in production.Minimum Qualifications3+ years experience in applied AI/ML roles with at least 1–2 years focused on LLMs or foundation models. Deep understanding of transformer-based models, their limitations, and evaluation strategies. Proficiency with Python and key libraries: Hugging Face Transformers, LangChain, OpenAI API, PyTorch/TensorFlow. Experience with tracing/debugging LLM outputs using tools like LangSmith, W&B Traces, or custom logs. Experience with model distillation, quantization, or fine-tuning on domain-specific tasks. Strong communication skills with the ability to translate complex model behavior into actionable insights.Preferred QualificationsPrior experience building or maintaining RAG pipelines (e.g., vector databases, retrieval logic, hybrid search). Knowledge of sports analytics or passion for football Familiarity with prompt evaluation benchmarks (e.g., TruthfulQA, MMLU, ARC) or custom evaluation harnesses. Experience with safety/guardrail frameworks (e.g., OpenAI Moderation, Guardrails.ai, Rebuff).Seniority levelSeniority level Mid-Senior level Employment typeEmployment type Full-time Job functionJob function Engineering and Information Technology Industries Software Development Referrals increase your chances of interviewing at PFF by 2x Get notified about new Data Scientist jobs inGreater Leeds Area . Leeds, England, United Kingdom 1 week ago Leeds, England, United Kingdom 1 week ago Senior Machine Learning Scientist (UK Remote)Leeds, England, United Kingdom 2 weeks ago Leeds, England, United Kingdom 1 week ago Software Developer (Python skills required)Leeds, England, United Kingdom 2 weeks ago Research Scientist (Biology) - AI TrainerResearch Scientist (Biology) - AI TrainerLeeds, England, United Kingdom 1 week ago AI Software Engineer (Fixed term 24 months)Leeds, England, United Kingdom 4 hours ago Wakefield, England, United Kingdom 15 hours ago Wakefield, England, United Kingdom 15 hours ago Research Scientist (Chemistry) - AI TrainerResearch Scientist (Chemistry) - AI TrainerData Science Analyst, General Insurance Risk SpecialistsLeeds, England, United Kingdom 19 hours ago Leeds, England, United Kingdom 1 week ago Research and Development Physicist - AI TrainerResearch Scientist (Physics) - AI TrainerShadwell, England, United Kingdom 3 weeks ago Junior Software Developer in Test - SDETLeeds, England, United Kingdom 4 days ago Leeds, England, United Kingdom 2 days ago Wakefield, England, United Kingdom 1 week ago Leeds, England, United Kingdom 1 week ago Leeds, England, United Kingdom 1 week ago Leeds, England, United Kingdom 2 weeks ago Leeds, England, United Kingdom 1 week ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.#J-18808-Ljbffr