- Anthropic has clarified that it does not support a blanket ban on open-weight AI models, with CEO Dario Amodei arguing that policy efforts should instead focus on preventing advanced AI chips from reaching authoritarian regimes, curbing industrial-scale model distillation, and mandating safety testing for powerful AI systems.
- Amodei proposed three policy measures: tightening controls on exports of advanced AI chips to China, cracking down on industrial-scale AI model distillation, and requiring mandatory safety testing for sufficiently capable AI models regardless of whether they are open or closed.
- Amodei emphasized that protectionist bans would not address the two biggest national security risks: authoritarian governments developing more capable AI systems than the United States, and the misuse of advanced AI models for cyber or biological attacks.
- Amodei clarified that reports of US officials considering a ban on Chinese open-weight models led to misconceptions that Anthropic supported such measures.
- Amodei disagreed with claims that open-weight models inherently improve AI safety, arguing that such assumptions should be validated through rigorous testing rather than accepted in advance.
- Anthropic called for tighter chip export controls, action against large-scale distillation, and mandatory safety testing for advanced AI models.
Anthropic CEO Dario Amodei has firmly rejected the notion of banning open-weight AI models, emphasizing their value as a public good. In a recent blog post, he stated, “Open-weights models that don't have dangerous capabilities are a public good: they don't cost anything besides the compute needed to run them, and they provide value to businesses, developers, and researchers.”123456
Instead of a ban, Amodei proposed three key policy measures: tightening controls on exports of advanced AI chips to authoritarian regimes, cracking down on industrial-scale AI model distillation, and requiring mandatory safety testing for sufficiently capable AI models, regardless of their open or closed status. He argued that protectionist bans would not effectively address the two most significant national security risks: authoritarian governments developing more capable AI systems than the U.S. and the potential misuse of advanced AI models for cyber or biological attacks.
Amodei clarified, “We have not and are not advocating for a ban on open-weights models as a category.” He believes that the focus should be on preventing powerful chips from falling into the hands of authoritarian regimes and ensuring rigorous testing of AI systems. He also expressed skepticism about the assumption that open-weight models inherently improve AI safety, stating that such claims should be validated through rigorous testing rather than accepted without scrutiny.
“Dario Amodei emphasized that protectionist bans won't mitigate national security risks, such as authoritarian governments developing superior AI systems. He also proposed tightening controls on advanced AI chip exports to China and requiring safety testing for capable AI models, regardless of their openness.”
livemint.com
