I. Introduction: The New Leviathan In 2023, over 1,000 tech leaders and researchers signed an open letter comparing the risks of artificial intelligence to those of pandemics and nuclear war. That same year, the European Union passed the world’s first comprehensive AI Act—a 400-page document classifying AI systems by risk level. Within months, ChatGPT, the poster child of generative AI, was banned in Italy, reinstated, and then faced 13 separate complaints across EU member states. Meanwhile, in the United States, the White House secured voluntary commitments from seven AI companies, while China implemented mandatory security reviews for “generative AI services with public opinion characteristics.”
The 2024 US Executive Order on AI attempts to address this via export controls on AI chips. But chips are physical; models are not. A company can train a model in a regulated jurisdiction, then copy the weights to an unregulated one. Once released, the model is immortal. No border patrol can stop mathematics. A. The Centralization Trap Most proposed regulations (compute thresholds, licensing requirements, mandatory reporting) disproportionately affect smaller players. A compliance burden that is trivial for Google or Microsoft is fatal for a university lab or a startup. The result is a regulatory moat: incumbents capture the state, and the state reinforces incumbents. This reduces the diversity of AI development, which is precisely what safety advocates want to avoid—diverse actors are harder to coordinate, but they also produce more innovation in safety techniques. Centralization creates monoculture, and monocultures are fragile. B. The Safety-Washing Loophole Regulation incentivizes box-checking, not risk reduction. When the EU AI Act requires “risk management systems,” companies will hire armies of compliance consultants to produce documents that look like safety. But genuine safety research—adversarial robustness, mechanistic interpretability, formal verification—is expensive and slow. Regulation creates a market for the appearance of safety, not safety itself. This is known as Goodhart’s law: when a measure becomes a target, it ceases to be a good measure. BIG LONG COMPLEX
These events reveal a singular, uncomfortable truth: Within months, ChatGPT, the poster child of generative
What, then, is to be done? The answer is unsatisfying but honest: we must regulate anyway, knowing we will fail, and iterate on the failure. We must build adaptive, technical, and distributed governance systems that learn faster than the models they constrain. We must accept that safety is not a state but a continuous, underfunded, thankless process—like democracy, like science, like every other human endeavor that has ever worked, however imperfectly. A company can train a model in a
Thus, the case for regulation is compelling. But compelling does not mean feasible. A. The Opacity of Black Boxes Regulation requires measurement. Measurement requires interpretability. Modern deep learning models are famously inscrutable. A neural network with hundreds of billions of parameters does not have “rules” an inspector can audit. It has weights—floating-point numbers that correlate with no human-understandable concept. When the EU AI Act demands transparency for “high-risk systems,” it assumes that a developer can explain why a model made a particular decision. For transformer architectures, this is often false. Explainability methods (LIME, SHAP, attention visualization) are post-hoc approximations, not ground truth. As one MIT researcher put it: “Asking why a neural network made a decision is like asking why a cloud looks like a rabbit. You can always find a story, but it’s not causation.” B. Regulatory Lag and AI Speed The typical regulatory cycle—problem identification, study, stakeholder comment, rule drafting, legal challenge, implementation, enforcement—takes 5–10 years. AI model generations take 3–6 months. GPT-3 to GPT-4 was 24 months. GPT-4 to GPT-5 is estimated at 12–18 months. By the time a law takes effect, the technology it governs no longer exists. This is the Red Queen problem: you have to run twice as fast just to stay in place.