As AI becomes more established in our lives, it is easy to take the technology for granted, and to not question the efficacy nor safety considerations. It is clear that AI has the capacity to be a significant enabler in helping drive efficiency, and automation when adopted safely. Within public sector organisations, there is a requirement to ensure that adoption of AI is undertaken in a considered way to protect data, and people.

Recent news reports about the use of Ambient Voice Technology (AVT) within the NHS, to record and transcribe patient information. Whilst NHS England had sought to promote the use of AVT, not all solutions meet with the NHS requirements for data protection and security governance. Additionally, AI tools can hallucinate (get things wrong) which can affect the integrity of data recorded, yet internet security firm Cloudflare, reports many users do not check the source of information. The NHS is due to set out its new 10 year plan, in which AI has been reported to be a key enabler for reform in the NHS. This highlights the importance of controlled and safe adoption of tools.

Independent of sector, it remains a priority for Boards and Audit Committees to seek assurance that AI use within the organisation meets with information security and efficacy standards, whether a commercial tool, or an AI agent using in-house data.

TIAA can provide independent, focussed support including an AI maturity assessment to help identify any gaps in the organisation’s safe adoption of AI.

Useful links:

Doctors are using unapproved AI software to record patient meetings, investigation reveals | Politics News | Sky News

NHS England » Guidance on the use of AI-enabled ambient scribing products in health and care settings

AI Security Institute – GOV.UK

Cloudflare CEO says people aren’t checking AI chatbots’ source links