Job Title-AI Test Lead (AI Foundry)

Client-Global Consulting Firm

Day Rate-£350-£400 (Outside IR35)

Duration-6 months (extendable)

Location-Leeds (Hybrid, 3 days per week in the office)

• Design and manage the enterprise testing strategy for AI/Copilot, blending traditional QA with AI‑specific methods.
• Define test approaches for functional, performance, accuracy, reliability, ethical compliance and bias detection.
• Establish model‑evaluation techniques (prompt variability, edge‑case simulation, output consistency, scenario reasoning).
• Validate explainability, traceability and safety controls against policy and regulatory requirements.
• Develop and maintain specialised test datasets, including adversarial, low‑quality, domain‑specific and edge‑case inputs, to rigorously challenge model robustness and identify systemic weaknesses.
• Provide AI test engineering support to delivery squads, advising on model‑readiness criteria, testability risks, and quality implications of design decisions, ensuring solutions are verifiable throughout the lifecycle.
• Define and run post‑deployment validation, drift detection, incident triage and continuous model‑monitoring.
• Lead incident investigations for unexpected AI behaviours, conducting deep‑dive root‑cause analysis across data quality, model logic, prompt flows, integration layers and human‑in‑the‑loop steps; identify systemic failure points, recommend corrective actions, and drive end‑to‑end remediation to prevent recurrence.
• Maintain test documentation, evaluation logs, datasets and reproducible evidence for audit.
• Champion continuous improvement of AI assurance, evaluating new testing tooling (LLM‑monitoring, bias‑scanners, prompt‑diff tools, synthetic data generators) and maturing standards as organisational AI adoption scales.
• Ensure responsible AI principles (e.g., transparency, explainability, ISO42001) are incorporated into all development.