AI has the potential to make customer service more efficient, including through voice assistants that can answer questions and help customers complete servicing tasks. But a natural-sounding conversation is not enough to establish that a system is reliable. Organisations need evidence that such systems can interpret customer requests accurately, provide reliable information and recognise when a person needs support from a human agent.
Lloyds Banking Group put these principles into practice when it explored the potential use of an AI assisted booking agent developed by one of its external partners. The system was designed to support voice and text conversations, retrieve information about products and policies, and use defined tools to carry out servicing tasks where those capabilities are enabled.
The assessment needed to consider more than the quality of individual answers. A misunderstanding early in a voice conversation could affect the information retrieved, the response given or, where permitted, an action taken on a booking. Responsible AI Specialists worked with the business and provider to understand these risks and gather evidence to inform the proposed use.
As the first voice AI agent use case considered by the Group, the proposal was referred to its Group’s Data & AI Ethics Committee. Questions of anthropomorphism and potential bias were explored. The committee determined that Responsible AI Specialists would support an exploration of the use case and conduct a risk assessment of the provider’s proposed solution. This created an opportunity to examine the technology before deciding which capabilities, if any, would be appropriate to enable.
The provider’s documentation, evaluation results and guardrails were reviewed through a series of detailed engagements. These were important starting points, but descriptions of testing and controls were not treated as sufficient evidence on their own. The team requested results, clarification of testing methods and further evaluation where gaps remained.