Article 14(1): High-risk AI systems shall be designed and developed in such a way, including with appropriate human-machine interface tools, that they can be effectively overseen by natural persons during the period in which they are in use. (2) Human oversight shall aim to prevent or minimise the risks to health, safety or fundamental rights that may emerge when a high-risk AI system is used in accordance with its intended purpose or under conditions of reasonably foreseeable misuse, in particular where such risks persist despite the application of other requirements set out in this Section. (3) The oversight measures shall be commensurate with the risks, level of autonomy and context of use of the high-risk AI system. Article 26(2): Deployers shall assign human oversight to natural persons who have the necessary competence, training and authority, as well as the necessary support.
How this was checked
Effective human oversight
Verified · last checked Settled, with the evidence a claim at this level needs.
Under the EU AI Act, high-risk AI systems must be designed so they can be effectively overseen by people while in use, with oversight aimed at preventing or minimising risks to health, safety or fundamental rights that may emerge in intended use or under reasonably foreseeable misuse, and with measures proportionate to the risk, the autonomy and the context. A deployer must assign that oversight to people who have the necessary competence, training and authority, as well as the necessary support. The system must also be provided to the deployer in such a way that those people are enabled, as far as is appropriate and proportionate, to remain aware of the tendency to rely or over-rely on what the system produces, which the regulation calls automation bias, in particular where the system provides information or recommendations for decisions a person then takes.
At a glance
The statement laid out, in its own words. The statement above and its sources are what count.
How the system is designed
- So that it can be effectively overseen by people while in use
- with oversight aimed at preventing or minimising risks to health, safety or fundamental rights in intended use or under reasonably foreseeable misuse
- with measures proportionate to the risk, the autonomy and the context
Who the deployer assigns
- People with the necessary competence, training and authority
- and the necessary support
Automation bias
- The system is provided so that those people are enabled, as far as is appropriate and proportionate, to remain aware of the tendency to rely or over-rely on what it produces
- in particular where it provides information or recommendations for decisions a person then takes
Where the book relies on it
- The AI Act File, Oversight that is not a rubber stamp. About The AI Act File
- Kind of evidence
- documentarySettled by a first-hand source, quoted below with the day it was read.
The evidence
Article 14(4): For the purpose of implementing paragraphs 1, 2 and 3, the high-risk AI system shall be provided to the deployer in such a way that natural persons to whom human oversight is assigned are enabled, as appropriate and proportionate: ... (b) to remain aware of the possible tendency of automatically relying or over-relying on the output produced by a high-risk AI system (automation bias), in particular for high-risk AI systems used to provide information or recommendations for decisions to be taken by natural persons;
Every sentence in our books that makes a claim about the world points at a page like this one.