Anthropic Warns of Potential Loss of Human Control Over AI Systems
Anthropic says new trend could see ‘humans losing control over AI systems’

Image: The Independent
AI company Anthropic cautions that humans may risk losing control over AI systems as its Claude model now autonomously writes over 80% of its own code, a significant increase from less than 10% last year. The firm suggests slowing AI development to mitigate risks.
- 01Claude model now autonomously generates over 80% of its own code, up from less than 10% in February 2022.
- 02Anthropic asserts that Claude's code quality is comparable to human-written code and may surpass it within the next year.
- 03Marina Favaro and Jack Clark from Anthropic warn that this trend indicates the potential for AI systems to autonomously design their successors.
- 04The company believes it may be prudent to slow AI development to address the associated risks, necessitating industry-wide agreement.
- 05The trend raises concerns about the implications of recursive self-improvement in AI systems.
Advertisement
In-Article Ad
Anthropic, an AI startup, has raised alarms about the increasing autonomy of its Claude model, which now generates over 80% of its own code, a dramatic rise from less than 10% in February 2022. This development suggests that Claude's coding capabilities are nearing parity with those of human programmers and could surpass them in the near future. In a blog post, Anthropic's Marina Favaro and Jack Clark expressed concerns that this trend could lead to AI systems capable of independently designing and developing their successors. They emphasized that while this advancement could enhance AI capabilities, it also heightens the risk of humans losing control over these systems. To mitigate these risks, Anthropic advocates for a potential slowdown in AI development, although they acknowledge that achieving a consensus across the industry would be necessary. This call for caution reflects a growing recognition of the implications of recursive self-improvement in AI technology and the need for responsible oversight as AI systems become increasingly autonomous.
Advertisement
In-Article Ad
Advertisement
In-Article Ad
Reader Poll
Do you think AI development should be slowed down to address potential risks?
Connecting to poll...
More about Anthropic
Read the original article
Visit the source for the complete story.






