The Technology Advisory Panel (TAP) of the Investigatory Powers Commissioner's Office (IPCO) has published an AI Proportionality Assessment Aid.
It described the resource as a framework designed to guide the proportionality assessment of AI models, and said it could have uses beyond applications under investigatory powers.
The Assessment Aid outlines key questions to consider at four stages of the AI model lifecycle.
First is the concept stage, evaluating the necessity and appropriateness of AI approaches for a specific purpose, considering biases, constraints, and policy for re-training and testing.
Second is development, focused on data sensitivities, human inspection, data volumes, biases and integrity, aimed at ensuring robust data management practices.
Third is for the operation stage, assessing the appropriateness of model use, data provenance, results delivery and human inspection requirements.
Finally is exploitation, examining access to results, training for appropriate use, model chains and reporting processes following adverse outcomes.
The tool is built on the recently released framework from the Centre for Emerging Technology and Security at The Alan Turing Institute for assessing privacy intrusion, and incorporates additional considerations.
Practical and comprehensive
Dame Muffy Calder, chair of the TAP, said: “This document provides a practical and comprehensive framework for assessing the proportionality of AI models, ensuring they are the appropriate tool for the task at hand.
“It is designed to guide stakeholders through the AI model lifecycle, from concept, to model development, application, and exploitation of results. The focus is on data driven models.
“We believe this aid will be an invaluable resource for those involved in the development, governance, and application of AI technologies.”
IPCO, which independently authorises and oversees the covert use of investigatory powers, has defined its scope of interest in AI, saying the technology is likely to have an early and significant impact on work within the intelligence sector. These processes typically involve the gathering, collation, analysis, and assessment of information, followed by actions taken against subjects of interest.
