News · 19 September 2024

The Council of Europe AI convention and why "contestable" matters

On 5 September 2024 the Council of Europe's Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law was opened for signature in Vilnius. The first signatories included the European Union, the United Kingdom, the United States, Israel, Norway and several other countries. It is described as the first legally binding international treaty on AI.

What is different about a treaty

The EU AI Act regulates products and markets. This convention starts from rights. It asks states to ensure that AI systems used by public authorities and, in various ways, by private actors respect human rights, the integrity of democratic processes and the rule of law. Principles it highlights include transparency and oversight, accountability, non-discrimination and the availability of remedies.

Contestability is an engineering requirement

A right to a remedy is empty if the person affected cannot find out how a decision was reached. This is the point where legal language turns into system design.

For a decision-support model to be contestable, you need at least:

  • A record: what input was used, which model version, what output and what a human did with it.
  • An account of the reasoning, in terms an affected person or their advocate can follow. It does not have to expose the maths; it has to expose the factors.
  • A route to a human who is able, and empowered, to override.
  • Monitoring for systematic problems, such as differences in error rates between groups.

These are the same features a clinician needs to trust a diagnostic aid, or a regulator needs to audit a risk model. Building them once serves several audiences.

The practical effect on teams

Public-sector customers and their suppliers will increasingly be asked to show how people can challenge outcomes. That affects procurement documents, not just courtrooms. If you build models used in health, social services or public administration, expect to be asked: how do we know why this person got this score, and who can change it?

Treaties move slowly, but the design questions they raise are available today, and answering them tends to improve the product regardless of the legal timetable.

Written in September 2024; details reflect the situation at that time.

All news