EU AI Act Explorer › Recitals › Recital 50
Recital 50

Human oversight design requirements

Regulation (EU) 2024/1689 - Artificial Intelligence Act · Preamble

AI systems should be designed and developed so as to allow natural persons to oversee their functioning, to ensure that they are used as intended, and that their unintentional impacts can be addressed during the system's lifecycle. In that regard, relevant human oversight measures should be identified by the provider before placing the system on the market or putting it into service. In particular, where appropriate, such measures should guarantee that the system is subject to in-built operational constraints that cannot be overridden by the system itself and is responsive to the human operator, and that the natural persons to whom human oversight has been assigned have the necessary competence, training and authority to carry out that role. AI systems should be designed and developed so that natural persons assigned to ensure human oversight are enabled, as appropriate, to interrupt, correct, override or reverse the AI system's outputs without undue friction. It is essential to ensure that high-risk AI systems are designed and developed in a way that includes appropriate human-machine interface tools and are able to be effectively overseen by natural persons during the period in which they are in use.