GDPR and AI: What the CNIL Specifically Expects from Companies

Other

The GDPR does not stop at the gateway to an AI system. As soon as a model is trained, fine-tuned, or used with data relating to an identified or identifiable individual, all the principles of Article 5 apply—including during the training phase itself—a fact that many technical teams discover too late. In light of this reality, the CNIL has published, since 2024, a collection of practical guides that specifies, point by point, what the GDPR actually entails for the development and use of AI systems—a framework that was significantly refined in 2025 and 2026, to the point where it now serves as a nearly operational reference rather than a text setting out general principles.

Myth vs. Reality: Does the GDPR Really Hinder AI Innovation?

The CNIL itself felt it necessary to state this explicitly: the notion that the GDPR would hinder innovation in artificial intelligence in Europe is false. The regulation does not prohibit the use of personal data for AI; rather, it sets out the conditions under which such use remains lawful. The question, therefore, is never “Does the GDPR allow this AI project?” but rather “What legal basis and safeguards ensure it can be carried out in compliance with the law?”

AI Training and the GDPR: Legitimate Interest as a Legal Basis

Published on June 19, 2025, and finalized in May 2026 following a public consultation, the CNIL’s recommendations on legitimate interest resolve an issue that had stalled many projects: consent, which is difficult or even impossible to obtain for massive and heterogeneous datasets, is not the only available option. Legitimate interest, as provided for inArticle 6(1)(f) of the GDPR, constitutes the most commonly applicable legal basis for the development of AI systems, provided that the requirements formalized by the CNIL as a three-part test are met.

The CNIL’s Three-Part Test: The Three Mandatory Criteria for Establishing Legitimate Interest

This test requires demonstrating three cumulative elements, each of which must be documented in writing and retained for audit purposes

 

    • Legitimacy requires that the purpose pursued be lawful and precisely defined; a generic statement such as “improving our services” in a data processing record is not sufficient.
    • It is necessary to explain why this objective cannot be achieved using anonymized or synthetic data, or a reduced data set.
    • Finally, the balancing test weighs the expected benefits of the processing against the potential harm to the individuals concerned, the risk that the model might memorize or regurgitate data, discriminatory biases, and the system’s lack of transparency. The CNIL explicitly notes that this assessment must be documented on a case-by-case basis and not treated as a generic formality applied without any substantive analysis.

Web Scraping and Data Collection: What Limits Has the CNIL Set?

The second part, published at the same time, addresses the conditions under which the collection of publicly available data on the web remains compliant. Web scraping is not prohibited in principle, but it must comply with the terms of use of the source sites and robots.txt files, exclude categories of data that are clearly sensitive, and ensure that data subjects have a right to object that is truly accessible. The CNIL provides a concrete example of the line that must not be crossed: creating a database of images collected indiscriminately from numerous websites—without excluding sensitive content or providing safeguards against the model storing such data—for a purpose as vague as “the provision of new services” would not satisfy the balancing requirement of the three-part test.

Sensitive Data (Article 9) and AIPD: The CNIL’s Enforcement Priorities

Sensitive data as defined inArticle 9 of the GDPR (health, political opinions, biometric data) generally cannot be used to train an AI system without a specific legal basis; legitimate interest alone is insufficient for these categories.

Which uses of AI trigger a mandatory Impact Assessment (AIPD)?

A Data Protection Impact Assessment (DPIA) becomes mandatory whenever an AI system poses a high risk to data subjects, which is often the case for HR, healthcare, or scoring applications. The CNIL therefore considers that, for the development of high-risk systems covered by the European AI Act and involving personal data, conducting a Data Protection Impact Assessment (DPIA) is, in principle, necessary.

The CNIL has explicitly identified AI as one of its priority areas for oversight in 2026, with a particular focus on AI processing operations that combine high risks and sensitive data, especially in the labor and healthcare sectors. In this context, inspections focus in particular on the processing register, data processing agreements entered into with AI providers (subcontractors), and the actual existence of the required data protection agreements, in accordance with standard GDPR obligations applicable to high-risk processing.

→ See our guide to corporate AI governance for an overview of the compliance process.

FAQ: GDPR Compliance as It Applies to AI

Does my AI system require an AIPD, and how do I create one?

Yes, if the processing poses a high risk to individuals’ rights and freedoms. For AI, the CNIL recommends an AIPD as soon as two criteria are met (sensitive data, large-scale collection, vulnerable individuals, data cross-referencing, innovative use, or new technologies) or if significant risks exist (discrimination, misuse, etc.). For high-risk systems as defined by the AI Act, a DPIA is generally required. The DPIA must be conducted prior to implementation and updated on an iterative basis. It must identify risks specific to AI (memorization/regurgitation, bias, poisoning attacks, loss of control over data, etc.) and define a plan of action to reduce them to an acceptable level.

Can I use legitimate interest to train my model?

Yes, this is often the most appropriate legal basis for AI development by private entities. However, the three-part test must be met: (1) a legitimate and precisely defined interest; (2) necessity (no less intrusive alternative); (3) a benefits-versus-risks assessment (memorization, regurgitation, bias, opacity). This analysis must be documented.

What security measures should be implemented for an AI system?

For AI, the CNIL (French Data Protection Authority) recommends combining “traditional” security (access, encryption, backups, DevSecOps) with an analysis of AI-specific risks: verification of data sources, versioning of datasets, anonymization/pseudonymization, output control (filters, watermarking ) , audits/ red teaming , and a rollback plan. The CNIL refers to frameworks such as EBIOS-RM , OWASP AI Security , ENISA, MITRE ATLAS, etc.

Am I the project lead, co-lead, or subcontractor on an AI project?

It depends on who determines the “why” (purpose) and the “how” (means) of processing personal data. If you decide these elements on your own , you are the data controller; if you do so with other organizations, you are joint controllers (contract required); and if you act on behalf of a data controller, you are a data processor (contract, security, notification). In the context of AI, the CNIL specifies that a provider may be the data controller if it builds its own training dataset, or a data processor if it follows your specific instructions.

Ensure Your Use of AI Complies with the GDPR

Our experts will help you ensure that your AI processing practices comply with CNIL recommendations.

Would you like to discuss your project or assess your needs? Contact our experts.

Webinaire gratuit · Hackmosphere × UrgenceCyber

Vos collaborateurs utilisent l'IA chaque jour. Votre surface d'attaque a déjà changé.

L'IA s'est installée dans vos équipes, et c'est une vraie opportunité. Mais chaque nouvel usage (prompts, agents, connecteurs...) élargit discrètement votre surface d'attaque, et c'est une bonne raison de faire le point. Un webinaire à deux voix, Hackmosphere et UrgenceCyber Région Sud, pour comprendre les risques réels et repartir avec une feuille de route applicable.

Mardi 24 novembre · 11h 1 h · En ligne (Teams)
Je m'inscris