Citation
L'auteur
Charles Ngando Black
(cngando@msn.com) - Institute for Data & AI Practices
Copyright
Déclaration d'intérêts
Financements
Aperçu
Contenu
A Simple Observation Facing a Complex Reality
A law or regulation must be useful. And it is only useful if it is effectively implemented. In the field of personal data protection, this observation today confronts a structural reality: the growing gap between the scope of the regulatory perimeter and the concrete capacities for supervision.
Globally, data protection frameworks now apply to several million organizations per country. In this context, supervisory authorities are tasked with supporting and ensuring the proper implementation of the framework. However, this mission can no longer be conceived solely through the historical prisms of individual inspections and sanctions.
This article provides a quantitative analysis of this phenomenon and develops an operational framework enabling supervisory authorities to manage effectiveness on a large scale, relying in particular on emerging technological solutions. It intentionally operates at the intersection of three registers: doctrinal analysis of regulatory models, empirical observation of supervisory practices based on annual reports from supervisory authorities, and the formalization of an operational framework intended to guide their transformation.
Theoretical Framework: From Traditional Regulation to Mass Supervision
The Limits of the Traditional Administrative Policing Model
The traditional regulatory model is based on a command and control logic, characterized by the issuance of prescriptive rules and their enforcement through direct inspections and sanctions (Ogus, 1994). This model assumes an authority’s capacity to regularly inspect regulated entities and detect violations.
In the field of data protection, this model encounters a scale problem. When Ayres & Braithwaite (1992) theorized responsive regulation, they already emphasized that regulatory effectiveness does not rest solely on the probability of detection, but on the capacity to adapt regulatory responses according to the behavior of actors. This pyramidal approach, where sanction is used only as a last resort, has profoundly influenced the modern conception of supervision.
Risk-Based Regulation and Meta-Regulation
Faced with the limits of exhaustive inspection, risk-based regulation (Black & Baldwin, 2010) proposes concentrating supervisory resources on the most significant risks. This model rests on three principles: (1) systematic identification of risks, (2) prioritization according to their probability and impact, and (3) differentiated allocation of inspection resources.
In parallel, meta-regulation (Coglianese & Mendelson, 2010) shifts the responsibility for compliance to the organizations themselves. Rather than directly verifying the application of each rule, the authority supervises the compliance management systems implemented by the actors. This logic of enforced self-regulation (Braithwaite, 1982) is at the heart of the accountability principle enshrined in the GDPR.
The Challenge of Mass Compliance
Hood, Rothstein & Baldwin (2001) demonstrated that the credibility of a regulatory regime depends not only on the severity of sanctions, but on the perception by regulated actors of the likelihood of being inspected and sanctioned. In a context of mass supervision, where the inspection rate becomes structurally marginal, this credibility requires new mechanisms: documentary traceability, self-assessment systems, and remote supervision tools become essential to maintain an acceptable level of effectiveness.
Methodology: Quantitative Analysis of International Supervision Reports
Corpus and Data Sources
This study is based on the systematic analysis of annual supervision reports published by 15 data protection authorities between 2021 and 2024, covering European jurisdictions (CNIL France, ICO United Kingdom, AEPD Spain, Garante Italy, DSB Germany), North American (OPC Canada), Oceanian (OAIC Australia), African (Information Regulator South Africa, CNDP Morocco) and Asian (PDPC Singapore, PDPA Thailand). This analysis combines two complementary levels: a quantitative comparison of inspection rates for the five jurisdictions that published sufficiently standardized and comparable data (section 3.2), and a qualitative analysis of supervisory trends drawing on the entire corpus of fifteen authorities (sections 3.1 and 3.3).
Quantitative Indicators Selected
Three key indicators were extracted and standardized:
- Annual number of effective inspections: on-site inspections, in-depth documentary audits, and compliance checks resulting in an inspection report.
- Estimated regulatory perimeter: number of organizations subject to obligations (calculated from national business registration data, adjusted according to the sectors of activity concerned).
- Annual inspection rate: ratio between the number of inspections and the regulatory perimeter.
Methodological Limitations
This analysis has three main limitations. First, the heterogeneity of definitions of « inspection » across jurisdictions required standardization that may reduce certain nuances. Second, the estimation of the regulatory perimeter relies on national statistical data that may underestimate or overestimate the actual number of organizations subject to obligations. Third, the reports do not always account for informal or preventive supervisory actions that also contribute to effectiveness. Fourth, the comparative table in section 3.2 only includes five jurisdictions (France, United Kingdom, Germany, Spain, Canada): the other ten authorities in the corpus did not publish sufficiently comparable data on the selected indicators to be included in this quantitative table, although they are used in the qualitative analysis of trends.
In this context, the effectiveness of a regulatory framework cannot be equated with either the intensity of inspection or the severity of sanction. It designates the capacity of the system, as a whole, to produce, on a large scale and over time, observable compliant behaviors, based on the demonstrable accountability of actors and on the permanent possibility of targeted supervision.
Results: International Convergences and Orders of Magnitude
First Convergence: The Continuous Growth of the Supervisory Burden
Analysis of the reports reveals an average annual increase of 23% in the volume of complaints received and 31% in security incident notifications between 2021 and 2024 (EDPB, 2024; CNIL, 2024; ICO, 2023). This growth is explained by several structural factors:
- The generalized digitalization of economic and administrative activities, which multiplies data processing and risk points (UNCTAD, 2023).
- The rise of digital platforms and business models based on the massive exploitation of personal data.
- The multiplication of cross-border data flows, which complicates supervision and requires international cooperation mechanisms (GDPR one-stop-shop mechanism, EU-US Data Privacy Framework since 2023, etc.).
- The increasing integration of emerging technologies (artificial intelligence, biometrics, connected objects) which raise novel data protection issues.
Second Convergence: Structurally Marginal Inspection Rates
The following table summarizes the observed orders of magnitude:
| Jurisdiction | Annual Inspections (2023) | Estimated Perimeter | Inspection Rate |
| France (CNIL) | 300-400 | ~3.5 million | 0.01% |
| United Kingdom (ICO) | 500-600 | ~4.2 million | 0.012% |
| Germany (DSB) | 800-1000 | ~5.8 million | 0.015% |
| Spain (AEPD) | 250-350 | ~2.8 million | 0.011% |
| Canada (OPC) | 150-200 | ~1.2 million | 0.013% |
Sources: Annual reports 2023-2024 of the relevant authorities (CNIL, 2024; ICO, 2023; DSB, 2023; AEPD, 2023; OPC, 2023). Inspection values correspond to formal inspection missions resulting in a written report; regulatory perimeters are estimates based on national business registers, adjusted according to sectors subject to data protection obligations. The other ten authorities in the corpus do not publish comparable data on these indicators (see section 2.3).
These data reveal an undeniable finding: in the jurisdictions studied, the annual inspection rate consistently falls between 0.01% and 0.02% of subject organizations. In other words, on average, an organization statistically has a probability of around 1/10,000 of being inspected in any given year, meaning a probability of being inspected once every 100 years if the rate remains constant.
This finding reflects neither a lack of will nor institutional failure. It highlights a structural reality: exhaustive inspection is mechanically impossible in a mass compliance regime. Consequently, the effectiveness of the framework can no longer be conceived primarily in terms of the probability of inspection or the severity of sanctions.
Qualitative Comparative Analysis of the Ten Other Authorities in the Corpus. Although the data published by the other ten authorities do not allow for quantitative standardization, their annual reports confirm and amplify the observed trends. The Australian OAIC (2023) and the Singaporean PDPC (2023) report volumes of formal inspections comparable to European authorities of similar size, with a marked orientation towards sectoral benchmarks and self-assessment tools. The Italian Garante and the German DSB, included in the qualitative corpus but insufficiently granular for the quantitative table, confirm the same order of magnitude for inspection rates (0.01–0.02%). At the other end of the spectrum, the Information Regulator of South Africa (2023), the Moroccan CNDP, and the Thai PDPA demonstrate a structurally more severe capacity constraint, with broad regulatory perimeters and limited staff, making proactive supervision and technological tools even more critical. These observations support the universal applicability of the quantitative conclusions, while highlighting the heterogeneity of contexts in which the five operational levers must be deployed (Greenleaf, 2022).
Third Convergence: The Gradual Shift Towards Support
Annual reports show a notable evolution in resource allocation. While inspections and sanctions retain strategic importance, authorities are dedicating a growing share of their resources to producing guidelines, sectoral benchmarks, self-assessment tools, and awareness-raising actions (CNIL, 2024; ICO, 2023; OAIC, 2023). This trend reflects a gradual shift in the role of authorities, who now assume a function of steering the regulatory ecosystem rather than a simple policing function.
Five Operational Levers for Effective Mass Supervision
Faced with this structural discrepancy between the regulatory perimeter and supervision capacities, several intuitive responses are regularly put forward: massively increase authority staff, toughen sanctions, automate violation detection, or outsource certain control functions. While each of these options may yield marginal gains, none solves the scale problem. They all rely, to varying degrees, on maintaining the individual inspection model, without addressing the central issue of large-scale effectiveness.
Empirical and theoretical findings allow us to identify five structural levers to ensure effectiveness in the era of mass supervision: (1) explicit structuring of organizational self-accountability, (2) demonstrable compliance as the central unit of supervision, (3) supervision based on risk signals rather than individual inspections, (4) transforming non-compliance into an operational cost, and (5) evolving the role of the supervisory authority towards managing large-scale effectiveness. These levers are neither independent nor interchangeable: the first two constitute structural prerequisites, the third enables the change of scale, the fourth is a systemic effect thereof, while the fifth ensures coherence and sustainability.
First Lever: Structuring Expectations Regarding Self-Accountability
The accountability principle enshrined in the GDPR (Article 5(2)) requires organizations to demonstrate their compliance. However, this requirement often remains abstract in the absence of clear standards on what constitutes satisfactory demonstration.
The first lever consists of clearly specifying documentary expectations: what elements must the organization be able to produce? Records of processing activities, impact assessments, rights management procedures, documentation of security measures, traceability of international transfers, evidence of staff training, etc.
Operational Example: The UK ICO published an Accountability Framework in 2023 detailing 12 categories of documentary evidence that any organization must be able to produce upon request. This benchmark allows organizations to structure their compliance management systems according to objective and verifiable criteria.
Second Lever: Making the Inability to Demonstrate a Risk Signal in Itself
In a context where inspections are rare, the ability to respond quickly and accurately to authority requests becomes a central indicator. The inability to produce requested elements, excessive response times, or documentary inconsistencies constitute in themselves warning signals that should trigger an escalation in supervision (Power, 1997).
This mechanism is based on a logic of revealing practices through traceability: an organization unable to document its processing likely reveals deeper flaws in its data governance.
Third Lever: Supervising by Aggregated Signals Rather Than Individual Inspections
Mass supervision requires moving beyond the logic of individual inspection to observe sectoral and systemic signals. These signals include:
- Recurring patterns in complaints (types of violations, sectors concerned).
- Grouped incident notifications revealing systemic failures (common vulnerabilities, failing suppliers).
- Systematic delays in responding to rights exercise requests.
- Absence of key mechanisms (DPO not appointed, no DPIA for high-risk processing).
This approach, inspired by prudential surveillance models in the banking sector, makes it possible to identify emerging risks before they materialize into major violations.
Fourth Lever: Making Non-Compliance Operationally Costly
Beyond financial sanctions, compliance must become a factor of organizational performance (Hood et al., 2001). Organizations that fail to structure their data governance face tangible operational costs:
- Multiplication of information requests from the authority, requiring the mobilization of internal resources.
- Inability to respond effectively to rights exercise requests, generating additional complaints.
- Difficulties in managing security incidents due to lack of documented procedures.
- Blockages in digital transformation projects due to lack of prior impact assessment.
This logic reverses the traditional perception: compliance is no longer a cost imposed by regulation, but an investment that reduces operational friction.
Fifth Lever: Technologically Equipping Mass Supervision
Mass supervision cannot operate without an appropriate technological infrastructure. Authorities must equip themselves with tools enabling them to:
- Collect and standardize compliance data on a large scale: declarations, records, incident notifications, responses to questionnaires.
- Automatically analyze this data to detect anomalies, identify risk patterns, and prioritize supervisory actions.
- Manage graduated controls: from simple information requests to in-depth documentary audits, including remote desk checks.
- Longitudinally track organizations to observe compliance evolution over time and detect deteriorations.
The Example of the RCS Platform (Regulatory Compliance Supervisor)
The RCS platform (Regulatory Compliance Supervisor, https://regcs.app) constitutes one example, among other emerging solutions, of what technological tools can bring to a supervisory authority. It enables managing large-scale supervision campaigns through standardized questionnaires, centralizing data from reviews and investigations, analyzing gaps to reveal sectoral risk signals, managing graduated and traceable control modalities, and producing dashboards to aid resource allocation. Comparable developments exist or are underway in other jurisdictions, whether proprietary tools or systems developed internally by authorities. Regardless of the system chosen, it does not replace the legal analysis or human judgment of the authority: it multiplies its capacity for action, making operational on a large scale the signal-based supervision theorized in the previous sections (Wieringa, 2020; Zarsky, 2017).
Conditions for Successful Technological Implementation
The effectiveness of these tools rests on three critical conditions:
- Standardization of data formats: collected information must be structured according to common schemas allowing aggregation and automated analysis. The lack of interoperability between systems currently constitutes a major obstacle.
- Gradual adoption and team training: introducing new tools requires organizational support. Authority staff must be trained not only in technical use, but above all in the critical interpretation of results produced by algorithms.
- Transparency and governance of supervision algorithms: scoring and prioritization criteria must be explained and discussed, both internally and with stakeholders, to guarantee the legitimacy of the system.
- Implications for Established and Emerging Authorities
For Historical Authorities: Consolidating a Hybrid Model
European authorities, which have operated for several decades, possess recognized expertise but are also constrained by organizational legacies. Their reports show a juxtaposition of actions—traditional inspections, sanctions, support—without always articulating them within a unified strategy.
The challenge for these authorities is to consolidate a hybrid model combining:
- In-depth inspections targeted at strategic or high-risk actors (large platforms, sensitive processing).
- Supervision mechanisms based on signals and aggregated data for the majority of the regulatory perimeter.
- Investment in technological tools and upskilling teams in data analysis.
For Emerging Authorities: Designing an Adapted Framework from the Outset
Many jurisdictions are currently creating their first data protection authorities (Africa, Southeast Asia, Latin America). These authorities face an immediate scale challenge: supervising millions of organizations with limited resources.
For these authorities, the challenge is not to reproduce historical models, but to design mass supervision frameworks from the start:
- Define clear and standardized documentary obligations from the outset.
- Integrate technological supervision platforms into the initial strategy rather than as an afterthought.
- Concentrate resources on steering the ecosystem (benchmarks, self-assessment tools, sectoral support) rather than on individual inspections.
- Build partnerships with other authorities to benefit from feedback and pool technological developments.
The experience of the Information Regulator of South Africa concretely illustrates this trajectory. Established by the Protection of Personal Information Act (POPIA) of 2013 and becoming fully operational in 2021, the authority must supervise several million organizations with initially limited staff. Rather than reproducing a model of individual inspection, it favored from the outset a prioritized sectoral approach, standardized documentary obligations, and a strong public communication strategy to maximize the preventive effect of its initial decisions. This choice of a natively designed mass supervision framework—rather than inheriting an individual inspection model to transform—illustrates the viability of the approach proposed in this article, even in resource-constrained contexts. It also opens the perspective of regulatory « leapfrogging »: certain emerging authorities could directly adopt industrialized practices without passing through the artisanal phase that characterizes the history of European authorities (Information Regulator South Africa, 2023; Greenleaf, 2022; Bamberger & Mulligan, 2015).
Towards a New Metric of Regulatory Effectiveness
Annual supervision reports reveal an unavoidable reality: with inspection rates on the order of 0.01 to 0.02%, the credibility of the data protection framework can no longer rest on the probability of being inspected or sanctioned. This quantitative study confirms what regulatory theory suggests: the effectiveness of a mass compliance regime is measured less by the number of inspections than by the system’s capacity to durably integrate the rule into organizational practices.
The five levers identified—structuring expectations, demonstrable compliance, signal-based supervision, operational cost of non-compliance, and technological tools—do not constitute a doctrinal break, but a realignment of the model with its actual scale. They build upon recognized theoretical frameworks (responsive regulation, risk-based regulation, meta-regulation) and find their concrete realization in operational solutions such as the RCS platform.
The transformation of supervisory authorities is not optional. It follows mechanically from the structural gap between the regulatory perimeter and supervision capacities. Authorities that maintain a model based exclusively on individual inspection will see their effectiveness progressively degrade, while those that adopt an ecosystem-steering approach will be able to maintain a high level of compliance on a large scale.
In this context, authority performance indicators must themselves evolve. Beyond the number of inspections and sanctions, it is appropriate to measure:
- The documentary coverage rate: proportion of organizations able to demonstrate their compliance.
- The quality of responses to requests: response time, completeness, coherence.
- The longitudinal evolution of compliance maturity indicators.
- The reduction of recurring incidents signaling systemic failures.
- The effective adoption of benchmarks and tools made available by the authority.
In the era of mass supervision, regulatory effectiveness is measured by the collective capacity—of organizations to structure their compliance and of authorities to steer this structuring—to make data protection a sustainable operational reality. It is on this condition that the rule fully regains its utility.
Although this article focuses on the field of data protection, the lessons it highlights concern more broadly contemporary regulations facing mass compliance, such as the regulation of digital platforms, consumer protection, anti-money laundering and counter-terrorist financing frameworks, certain ESG requirements, or emerging governance frameworks for artificial intelligence, all of which share the same scale constraint and the same limits of individual inspection.
Bibliographie
Article 29 Working Party (2010). Opinion 3/2010 on the principle of accountability. WP 173.
Ayres, I., & Braithwaite, J. (1992). Responsive Regulation: Transcending the Deregulation Debate. Oxford University Press.
Bamberger, K. A., & Mulligan, D. J. (2015). Privacy on the Ground: Driving Corporate Behavior in the United States and Europe. MIT Press.
Bennett, C. J., & Raab, C. D. (2006). The Governance of Privacy: Policy Instruments in Global Perspective. MIT Press.
Black, J., & Baldwin, R. (2010). Really Responsive Risk-Based Regulation. Law & Policy, 32(2), 181-213.
Braithwaite, J. (1982). Enforced Self-Regulation: A New Strategy for Corporate Crime Control. Michigan Law Review, 80(7), 1466-1507.
CNIL (2024). Activity Report 2023. Commission Nationale de l’Informatique et des Libertés.
Coglianese, C., & Mendelson, E. (2010). Meta-Regulation and Self-Regulation. In R. Baldwin, M. Cave, & M. Lodge (Eds.), The Oxford Handbook of Regulation (pp. 146-168). Oxford University Press.
EDPB (2024). Annual Report 2023. European Data Protection Board.
Greenleaf, G. (2022). Global data privacy laws 2022: 162 national laws, 20 bills. Privacy Laws & Business International Report, 176, 1-6.
Hood, C., Rothstein, H., & Baldwin, R. (2001). The Government of Risk: Understanding Risk Regulation Regimes. Oxford University Press.
ICO (2023). Annual Report and Financial Statements 2022-23. Information Commissioner’s Office.
Information Regulator South Africa (2023). Annual Report 2022/23.
Kuner, C., Bygrave, L. A., & Docksey, C. (2020). The EU General Data Protection Regulation (GDPR): A Commentary. Oxford University Press.
OAIC (2023). Annual Report 2022-23. Office of the Australian Information Commissioner.
OECD (2014). The Governance of Regulators. OECD Best Practice Principles for Regulatory Policy. OECD Publishing.
Ogus, A. (1994). Regulation: Legal Form and Economic Theory. Oxford University Press.
OPC (2023). Annual Report 2022-23. Office of the Privacy Commissioner of Canada.
Power, M. (1997). The Audit Society: Rituals of Verification. Oxford University Press.
UNCTAD (2023). Data Protection and Privacy Legislation Worldwide. United Nations Conference on Trade and Development.
Wieringa, M. (2020). What to account for when accounting for algorithms: A systematic literature review. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (FAT* ’20) (pp. 1-18). ACM.
Zarsky, T. (2017). Incompatible: The GDPR in the Age of Big Data. Seton Hall Law Review, 47(4), 995-1020.
il ne peut pas avoir d'altmétriques.)