AI models may soon self-replicate without access to data centers, Anthropic warns
Synopsis
A recent study by Anthropic highlights the alarming potential for small AI models to self-replicate on insecure IoT devices. Their research shows that models containing under 30 billion parameters can replicate, albeit facing difficulties with ongoing reproduction. Targeted devices include smart home products and Android TVs. If previous patterns persist, we might witness full autonomy in replication by the end of this year.
Listen to this article in summarized format
ReutersAnthropic said on Monday its experiments suggested small AI models may be months away from being capable enough to self-replicate on commercial internet-of-things (IoT) devices, such as smart ovens and off-brand Android TV boxes.
In its experiments, Anthropic looked at whether AI models could find vulnerable devices, copy themselves into those devices, and continue spreading without human help.
It found that small models under 30 billion parameters could complete the many steps needed for replication.
However, the firm found that such AI models also struggled to complete the entire sequence from start to finish.
In its simplified tests, where some security steps were removed, Anthropic found that GLM-5.2 and stronger models were capable of end-to-end replication.
Replicating models would be hard to shut down as there is no central switch-off point and, unlike non-AI malware, they could also figure out unfamiliar devices on their own, targeting data center processors, Anthropic warned.
The firm focused on IoT devices like Android TVs, smart appliances, and other internet-connected gadgets in its research as these are typically poorly secured.
The AI major also warned that if small models improved at their historical rate, they would be able to autonomously replicate by the end of this year, with small weight-based replicators following suit soon after.
Anthropic also said such autonomous AI systems were likely to replicate slowly and rely on widely available, relatively insecure computing resources. It added that systems should be strengthened to make it harder for such AI agents to spread.
In its experiments, Anthropic looked at whether AI models could find vulnerable devices, copy themselves into those devices, and continue spreading without human help.
It found that small models under 30 billion parameters could complete the many steps needed for replication.
However, the firm found that such AI models also struggled to complete the entire sequence from start to finish.
In its simplified tests, where some security steps were removed, Anthropic found that GLM-5.2 and stronger models were capable of end-to-end replication.
Replicating models would be hard to shut down as there is no central switch-off point and, unlike non-AI malware, they could also figure out unfamiliar devices on their own, targeting data center processors, Anthropic warned.
The firm focused on IoT devices like Android TVs, smart appliances, and other internet-connected gadgets in its research as these are typically poorly secured.
The AI major also warned that if small models improved at their historical rate, they would be able to autonomously replicate by the end of this year, with small weight-based replicators following suit soon after.
Anthropic also said such autonomous AI systems were likely to replicate slowly and rely on widely available, relatively insecure computing resources. It added that systems should be strengthened to make it harder for such AI agents to spread.
Add 
as a Reliable and Trusted News Source
as a Reliable and Trusted News Source
Add Now!(Catch all the Technology News News, and Latest News Updates on The Economic Times.)
...more
Add Comment
Elevate your knowledge and leadership skills at a cost cheaper than your daily tea.
Curbing rupee bets: What the RBI’s new rules mean for the hedge-now-or-wait question Brinjal, buffalo, bacteria: Inside India’s pay-for-nature system Homebuyers wait as NCLT panel picks holes in unfinished Jaypee projects The NBFC saga - Part 3: How one default in 2018 changed the way RBI reads risk Four rules made HDFC Bank a compounder. All four have stopped. Can the new CEO rewrite them? What is the real impact of 13x jump in cash transfers to women? The NBFC saga - Part 2: Line drawn in 2006 is reason for the headlines today Airlines Q2 turbulence: Fewer passengers, rising fares and a crude shock Britannia’s next big bet for young India lies beyond biscuits The world is witnessing a bond rout. Why should it matter to you?
Subscribe Now