AI Ops Engineer

Requisition ID2433 -Posted09/08/2026 -IT -IT - External Location (2) -IT

Hybrid working available (a minimum of 3 days working from the office, 2 days working from home)

The job in a nutshell

Monitors agent performance across the BB&R estate - reporting and flagging on performance, whilst tuning the routing and logic. Works with AI Engineering Lead on delivery tasks. Owns the Orchestrators and Monitoring agents shared across all process areas. Also provides support on internal dotnet platforms.

Who you will work with

Internal: AI Lead Engineer (reports to); process area leads and agent-owning roles across Buying, Offer Admin and Customer Contact processes whose agents this role monitors. Application Support team for 3rd party app integrations

External: Agentic plaform vendors; Suppliers & SaaS Providers

3rd party business application partners

What you will do

• Owns Orchestrators and Monitoring agents (shared/central, cross-process)
• Monitors agent performance across the estate
• Reports and flags on performance issues
• Tunes routing and logic
• Optimise agent costs by testing and validating model performance using optimised lower cost models and progressing these into production
• Define new AI agent capabilities and interfaces to replace legacy processes
• Maintain and Enhance in house dotNet applications as directed

Experience / Achievements

• Demonstrable experience in quality assurance and output monitoring
• Proven experience in escalation management and pattern recognition
• Experience of analytical thinking applied to high-volume outputs
• Experience producing clear written communication for exception reports
• Demonstrable experience in AI agent development and optimisation
• Deep experience with API and MCP integration and agentic platform system architecture
• Understanding of Microsoft dotnet development platform and Azure+ services

Your Skills, Knowledge and Behaviours

• Strong attention to detail across high-volume agent outputs
• (Desirable) Experience in Lyzr and/or Microsoft Foundry platform
• (Desirable) Dashboard and alerting tools
• (Desirable) Process improvement methodology and data visualisation

We support our colleagues with a wide range of benefits:

• you will start with 24 days' holiday
• and 3 additional days over the Christmas period and 1 Personal Day
• Private Medical cover & Health plan
• Life Insurance
• Pension
• Employee Assistance Programme (EAP)
• generous Employee discount (up to 40% off products)
• and many more.

N.B. We reserve the right to close a vacancy before the closing date in the event of an overwhelming response or a change in business priorities.

#J-18808-Ljbffr