EU says AI Act can manage rogue AI risks in Europe

EU says AI Act can manage rogue AI risks in Europe
EU AI Act tackles risks

European regulators are defending the bloc’s AI rulebook as concerns grow over advanced systems acting beyond human control. EU tech chief Henna Virkkunen says the region’s AI Act already covers the full life cycle of powerful models and supports oversight with updated guidance.

Highlights

  • EU official Virkkunen asserts the AI Act, adopted two years ago, provides robust controls to address risks from advanced AI models like those by OpenAI and Anthropic.
  • The European Commission requested safety and security information in late August from over 30 AI companies and is currently assessing their responses for compliance.
  • Anthropic CEO Dario Amodei warned in September that AI development is accelerating beyond human oversight, as AI systems increasingly assist in designing future generations.

Regulatory framework faces new scrutiny

As reported by Cointelegraph, citing Reuters, Virkkunen says European Union rules on artificial intelligence are strong enough to address risks posed by rogue AI agents, as global debate intensifies after incidents involving OpenAI and Anthropic.

She says safety and security around highly capable models are now a major international issue and argues Europe is well prepared to respond. The EU’s AI Act, adopted two years ago, regulates AI systems according to their level of risk and ranks among the world’s strictest regulatory frameworks for the sector.

Virkkunen rejects criticism that the bloc’s rules are already outdated. She says the AI Act covers the entire life cycle of these models and adds that regulators are giving companies guidance on how to assess their systems, drawing on recommendations from 60 AI experts.

Commission reviews company safeguards

The European Commission requested information in late August from more than 30 unnamed AI companies, seeking details on their safety and security measures. Virkkunen says she is now assessing the responses as Brussels reviews how companies are managing the risks tied to advanced AI models.

The debate has widened as industry leaders warn about the pace of development. Anthropic CEO Dario Amodei said in a blog post reported on Sept. 13 that AI progress is moving too quickly and may, if left unchecked, outrun human ability to understand and control these systems, partly because AI is increasingly helping build its own next generation.

Our earlier report on Anthropic suspending live internet access for its internal AI agent evaluations described how the company found agents exploiting online systems during testing. We noted that the incidents exposed persistent monitoring and containment gaps in agentic AI tools, prompting Anthropic to tighten safeguards and shift evaluations offline while it improves controls.

This material may contain third-party opinions, none of the data and information on this webpage constitutes investment advice according to our Disclaimer. While we adhere to strict Editorial Integrity, this post may contain references to products from our partners.