&imwidth=800&imheight=600&format=webp&quality=medium "Nvidia unveils open-source security system to stop AI agents going out of human control")
Nvidia Corp. has unveiled a new two-layer artificial intelligence (AI) security system which it claims would’ve stopped the recent high-profile breach of Hugging Face involving OpenAI’s AI models. The chip giant is rolling out two open-source software security tools that could be run on its hardware. The company claimed that the tools are designed to control what AI agents can access in real time and close them when they break the rules. It has also been rapidly expanding its product lineup beyond chips.
Jensen Huang, Nvidia CEO, has played down the need for new AI regulations and argued that the software should be vigorously safety-tested. Justin Boitano, Nvidia’s vice president of enterprise AI, also said that if cutting-edge labs had used this technology earlier to evaluate their AI models, it could have warned of the Hugging Face attack. “From what we know, this new security platform could have stopped the breach,” he said.
Also read: After months of tension, Anthropic CEO Amodei to dine one-on-one with Trump at White House
Open Agent Safety Platform
After the incident related to misconduct by autonomous agents, the AI industry has been prompted to slow down work on the technology. To prevent breaches without stopping further development of AI, Nvidia is coming up with a new product, dubbed the Open Agent Safety Platform.
However, Jensen Huang, the chipmaker’s chief executive officer, has continuously downplayed AI-related risk slipping out of human control. But Boitano didn’t make any remark on whether OpenAI or rival Anthropic PBC have plans to use its new system to detect their training runs, deferring to the companies.
Trending Stories
)
US vs China over South China Sea: Washington backs Philippines, Beijing hits back
)
Bigg Boss 20: Isha Rikhi evicted after three weeks in Salman Khan’s show
)
Musk plans to more than double xAI's chips to over 1.2 million Nvidia GPUs by year-end
)
After JU, clash erupts at SRFTI: BJP’s ‘Dimagi Naxal’ jibe sparks political firestorm after students protest RSS-linked event
)
‘Anti-social elements spreading false rumours’: LPU issues statement amid massive unrest over alleged rape
)
LPU students go on rampage, vandalise campus amid widespread protest: What's happening
)
Trump asked Xi to pressure Iran. China did not say yes — here’s what Beijing wants
)
US Treasury Secretary Scott Bessent hails global crackdown on Iranian banks and airlines
)
An OpenAI agent escaped its locked test cage again, by hiding questions in DNS lookups
)
'Our video was trimmed': LPU girls who featured in rape-denial video make U-turn
)
3 males killed, four others injured in shooting after fight at strip club in Detroit
)
'Victory for low-budget consumers': Raghav Chadha hails 30-day telecom recharge rules
)
Claude rebuilt the 1989 game 'Prince of Persia' by reusing the original's own code
)
Beyond metros: How Tier-2 and Tier-3 cities could drive India’s next AI wave
)
Tesla builds first Cybertruck with its own refined lithium: Elon Musk's $1 billion Texas bet pays off
)
IndiGo flight suffers tail strike in Bengaluru while landing; DGCA to probe incident
)
The US and China set up an AI 'red telephone', but skipped the rulebook
)
‘Terror suspects arrested near UK air base were looking to do big damage’: Trump
)
Russian envoy claims US tactics to contain India were revealed in ‘Freudian slip’
)
IND vs WI 1st ODI: Kohli breaks Sachin's most runs in one country record with unbeaten 139 as India thump West Indies by 8 wickets
)
Researchers rebuilt exactly how 700 AI agents hacked Hugging Face: a 900-link chain trick
)
‘Olympic inclusion is our major target’: WPA President Ishaun Singh on pool’s global ambitions
)
Nations League: Spain sink England at Wembley; Modric shines for Croatia
)
Why has Iran released no proof of life of Mojtaba Khamenei? Araghchi reveals...
)
'What kind of confession is this?': Pakistan PM Shehbaz Sharif’s 'terrorists would be roaming New York' remark goes viral, raises alarm online. Watch
)
South Korea demands apology from Ukraine over North Korean prisoners' transfer
)
Beyond BrahMos: India targets Rs 50,000 crore in defence exports with unmatched price edge
)
Sri Lankan Tamil migrant worker gets death sentence in Saudi Arabia, help sought from India
)
Muslim marriage cannot shield sex with minor wife from prosecution under POCSO: Delhi HC
)
'Can't help but draw painful parallels to Nirbhaya case': SC on latest incidents of rape cases in Delhi-NCR
)
99.9% more powerful - Scientists find boy who can recall memories from just 3 months of age
)
'FIRST LOOK from inside Noah’s Ark': Researchers share video from inside mysterious mound in Turkey
)
UNSC reform momentum grows: Russia, Portugal, Mauritius push for India's permanent seat bid
)
8 US marines injured in Iranian missile attack on vessel in Strait of Hormuz: Report
&im=FitAndFill=(700,400))
New OTT releases this week (September 28-October 4, 2026): Dupahiya 2, Pooja Meri Jaan, Ohh My Dog- 5 titles coming on Netflix, Prime Video and more
)
Afghanistan says 28 fighters killed in clash near Pakistan border, Islamabad denies
)
Ceuta migrant crisis: Protesters take to streets as Spain grapples with migrant challenge
)
LPU suspend classes, postpones exams as violence escalates over rape claims: What's happening
)
New York City wants a 'kill switch' on every AI, and will pay whistleblowers who report violations
In recent days, Huang has framed AI safety as a technical problem to be solved through engineering, not a reason for tighter regulation or international coordination. Like President Trump, he has rejected claims from some AI developers that the technology could bring about human extinction, though he maintained that AI systems must still undergo rigorous safety testing.
