Local authorities are being left without adequate support to procure AI in the public interest, according to newly published research from the Ada Lovelace Institute.
It says that, despite a proliferation of guidance documents from government, councils do not have access to a clear, comprehensive or consistent account of how to procure AI in the public interest.
This means they face significant challenges in navigating existing guidance and relevant legislation during procurement.
The report - lead authored by Anna Studman with input from Hannah Claus, Mavis Machirori and Imogen Parker - is based on analysis of 16 guidance, legislation and policy documents on procurement of AI and data driven systems published between 2010-24. The team also looked at broader legislation related to impacts on people and society, such as the Public Sector Equality Duty (PSED).
This established that there is a particular problem in a lack of clarity about how to apply concepts like fairness, define public benefit and ensure that the use of AI is transparent and understandable to affected people.
Suggestions for improvement
The report includes a number of practical suggestions for improving procurement of AI and data systems in local government, including clearer guidance, definitions, success metrics and responsibilities. It also calls for the wider use of governance mechanisms like the Algorithmic Transparency Recording Standard, piloting impact assessments and supporting public participation.
Imogen Parker, associate director at the Ada Lovelace Institute, said: “Procurement can and should be a key lever in ensuring that AI tools being used by local government are safe, effective, fair and in the public interest. Local authorities face the unenviable task of having to navigate unclear, overlapping and sometimes conflicting guidance.
“It's essential that the procurers in the public sector are confident about the products they are buying in - and neither they nor the public are put at risk.
“Embedding a robust, ethical procurement process in the context of reduced budgets is of course a significant challenge. But it is important to also consider the cost of not doing this, both financially and ethically, something demonstrated all too clearly by the Post Office’s Horizon scandal.”
Rising expectations
The institute said the research lands amidst rising expectations about the potential of AI in the public sector. While there is optimism that AI could enhance public services, this will only be achieved if the public sector can ensure the adoption of new technologies are safe, effective and in the public interest.
It added that paper a second publication will follow, based on qualitative and collaborative research with procurement stakeholders from across the public and private sectors.
