#propensitybench — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #propensitybench, aggregated by home.social.
-
#AI Agents Care Less About Safety When Under Pressure - IEEE Spectrum
… artificial-intelligence #agents sometimes decide to misbehave... But such behavior often occurs in contrived scenarios. Now, a new study presents #PropensityBench , a #benchmark that measures an #agentic model’s choices to use harmful tools in order to complete assigned tasks. It finds that somewhat realistic pressures (such as looming deadlines) dramatically increase rates of misbehavior.
-
A new #study using #PropensityBench, a benchmark for measuring #AIagents’ propensity to use #harmfultools, found that #realisticpressures like #deadlines and #financiallosses significantly increase #misbehaviour rates. The study tested a dozen models from various companies across nearly 6,000 scenarios, revealing that even under zero pressure, the average failure rate was 19%. https://spectrum.ieee.org/ai-agents-safety?eicker.news #tech #media #news
-
A new #study using #PropensityBench, a benchmark for measuring #AIagents’ propensity to use #harmfultools, found that #realisticpressures like #deadlines and #financiallosses significantly increase #misbehaviour rates. The study tested a dozen models from various companies across nearly 6,000 scenarios, revealing that even under zero pressure, the average failure rate was 19%. https://spectrum.ieee.org/ai-agents-safety?eicker.news #tech #media #news
-
A new #study using #PropensityBench, a benchmark for measuring #AIagents’ propensity to use #harmfultools, found that #realisticpressures like #deadlines and #financiallosses significantly increase #misbehaviour rates. The study tested a dozen models from various companies across nearly 6,000 scenarios, revealing that even under zero pressure, the average failure rate was 19%. https://spectrum.ieee.org/ai-agents-safety?eicker.news #tech #media #news
-
A new #study using #PropensityBench, a benchmark for measuring #AIagents’ propensity to use #harmfultools, found that #realisticpressures like #deadlines and #financiallosses significantly increase #misbehaviour rates. The study tested a dozen models from various companies across nearly 6,000 scenarios, revealing that even under zero pressure, the average failure rate was 19%. https://spectrum.ieee.org/ai-agents-safety?eicker.news #tech #media #news
-
A new #study using #PropensityBench, a benchmark for measuring #AIagents’ propensity to use #harmfultools, found that #realisticpressures like #deadlines and #financiallosses significantly increase #misbehaviour rates. The study tested a dozen models from various companies across nearly 6,000 scenarios, revealing that even under zero pressure, the average failure rate was 19%. https://spectrum.ieee.org/ai-agents-safety?eicker.news #tech #media #news