#aisafety — Public Fediverse posts

“A temporary recall of general-purpose agents until this mess can be sorted out”
Gary Marcus · garymarcus.substack.com
https://aizeitgeist.tv/m/2026-09-27-a-temporary-recall-of-general-purpose-agents-until-this-mess
#AI #AIZeitgeist #AISafety

“A temporary recall of general-purpose agents until this mess can be sorted out”
Gary Marcus · garymarcus.substack.com
https://aizeitgeist.tv/m/2026-09-27-a-temporary-recall-of-general-purpose-agents-until-this-mess
#AI #AIZeitgeist #AISafety

“A temporary recall of general-purpose agents until this mess can be sorted out”
Gary Marcus · garymarcus.substack.com
https://aizeitgeist.tv/m/2026-09-27-a-temporary-recall-of-general-purpose-agents-until-this-mess
#AI #AIZeitgeist #AISafety

“A temporary recall of general-purpose agents until this mess can be sorted out”
Gary Marcus · garymarcus.substack.com
https://aizeitgeist.tv/m/2026-09-27-a-temporary-recall-of-general-purpose-agents-until-this-mess
#AI #AIZeitgeist #AISafety

“A temporary recall of general-purpose agents until this mess can be sorted out”
Gary Marcus · garymarcus.substack.com
https://aizeitgeist.tv/m/2026-09-27-a-temporary-recall-of-general-purpose-agents-until-this-mess
#AI #AIZeitgeist #AISafety

You know, I agree we should stop the development of ASI but, if it's by big tech. Why should you expect ASI to be developed by assholes who didn't see they are liable by their own failure?

Open source model should be the one become ASI.

Have a clip of Amodei parody

Clip source: Saturday Night Live

#cybersecurity #infosec #AISafety #AISecurity #policy #saturdaynightlive #Amodei #Anthropic #AI

You know, I agree we should stop the development of ASI but, if it's by big tech. Why should you expect ASI to be developed by assholes who didn't see they are liable by their own failure?

Open source model should be the one become ASI.

Have a clip of Amodei parody

Clip source: Saturday Night Live

#cybersecurity #infosec #AISafety #AISecurity #policy #saturdaynightlive #Amodei #Anthropic #AI

You know, I agree we should stop the development of ASI but, if it's by big tech. Why should you expect ASI to be developed by assholes who didn't see they are liable by their own failure?

Open source model should be the one become ASI.

Have a clip of Amodei parody

Clip source: Saturday Night Live

#cybersecurity #infosec #AISafety #AISecurity #policy #saturdaynightlive #Amodei #Anthropic #AI

You know, I agree we should stop the development of ASI but, if it's by big tech. Why should you expect ASI to be developed by assholes who didn't see they are liable by their own failure?

Open source model should be the one become ASI.

Have a clip of Amodei parody

Clip source: Saturday Night Live

#cybersecurity #infosec #AISafety #AISecurity #policy #saturdaynightlive #Amodei #Anthropic #AI

#Gefahren #künstlicherIntelligenz : #OpenAI pausiert Training seiner leistungsstärksten #KIModelle #AISecurity #AISafety https://www.spiegel.de/netzwelt/kuenstliche-intelligenz-openai-pausiert-ki-training-nach-neuem-zwischenfall-a-11843c62-2ff2-48ae-accb-bbb89abc936b?sara_ref=re-so-tw-sh via @derspiegel

#Gefahren #künstlicherIntelligenz : #OpenAI pausiert Training seiner leistungsstärksten #KIModelle #AISecurity #AISafety https://www.spiegel.de/netzwelt/kuenstliche-intelligenz-openai-pausiert-ki-training-nach-neuem-zwischenfall-a-11843c62-2ff2-48ae-accb-bbb89abc936b?sara_ref=re-so-tw-sh via @derspiegel

#Gefahren #künstlicherIntelligenz : #OpenAI pausiert Training seiner leistungsstärksten #KIModelle #AISecurity #AISafety https://www.spiegel.de/netzwelt/kuenstliche-intelligenz-openai-pausiert-ki-training-nach-neuem-zwischenfall-a-11843c62-2ff2-48ae-accb-bbb89abc936b?sara_ref=re-so-tw-sh via @derspiegel

https://www.europesays.com/people/244579/ ‘A Billion Deaths’: Bill Gates Issues Apocalyptic Warning Over Unchecked AI | World News #AICatastrophicEvents #AIRegulation #AISafety #ArtificialIntelligence #BillGates #BillGatesAIWarning #GovernmentOversight #TechFirms #Weaponization

I'm writing a follow-up blog post on #AISafety that checks in on recent containment events to see how concerned we actually need to be. As I do research I'm realising how big the topic is and how little I actually know...

I'm writing a follow-up blog post on #AISafety that checks in on recent containment events to see how concerned we actually need to be. As I do research I'm realising how big the topic is and how little I actually know...

I'm writing a follow-up blog post on #AISafety that checks in on recent containment events to see how concerned we actually need to be. As I do research I'm realising how big the topic is and how little I actually know...

I'm writing a follow-up blog post on #AISafety that checks in on recent containment events to see how concerned we actually need to be. As I do research I'm realising how big the topic is and how little I actually know...

I'm writing a follow-up blog post on #AISafety that checks in on recent containment events to see how concerned we actually need to be. As I do research I'm realising how big the topic is and how little I actually know...

https://www.europesays.com/people/244384/ AI systems are advancing too fast, Anthropic CEO warns #AISafety #Anthropic #AutonomousAgents #cyberattacks #DarioAmodei #IndependentEvaluators #ModelDevelopment #PacingTheFrontier

What are the governments of the world waiting for to force OpenAI and Anthropic to open-source their models and divulge all their weights, training prompts, and algorithms? Open Source AI NOW!

"OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents in which their frontier models took steps that outside evaluators would consider problematic, sources told Axios.

Why it matters: The sheer number of incidents, which occurred in recent months in internal testing and the real world, indicates that the problem is orders of magnitude more complex than what is publicly known.

The findings, which are surfacing as part of internal work to assess models and in investigations at both companies into model behavior, raise questions about whether either company — or any top model-maker — is currently capable of establishing complete control over their technology.

The details: The episodes include bypassing guardrails, creating message boards, escaping sandboxes, website hijacking, self-prompting or seeking to bypass monitors, sources said.

They occurred in internal testing and in the real world, and many have yet to become public as security researchers continue to investigate, sources said.

Some of the testing is akin to "red-teaming" activity, where the companies are trying to get the models to misbehave in order to ensure that they are safe, sources said.

Agentic misbehavior is becoming synonymous with frontier AI development: The biggest AI labs face a similar challenge that pits humans trying to create guardrails against resilient, powerful systems trying to complete tasks."

https://www.axios.com/2026/09/26/openai-anthropic-thousands-ai-security-incidents

#CyberSecurity #AI #OpenAI #Anthropic #LLMs #AIAgents #AISafety

What are the governments of the world waiting for to force OpenAI and Anthropic to open-source their models and divulge all their weights, training prompts, and algorithms? Open Source AI NOW!

"OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents in which their frontier models took steps that outside evaluators would consider problematic, sources told Axios.

Why it matters: The sheer number of incidents, which occurred in recent months in internal testing and the real world, indicates that the problem is orders of magnitude more complex than what is publicly known.

The findings, which are surfacing as part of internal work to assess models and in investigations at both companies into model behavior, raise questions about whether either company — or any top model-maker — is currently capable of establishing complete control over their technology.

The details: The episodes include bypassing guardrails, creating message boards, escaping sandboxes, website hijacking, self-prompting or seeking to bypass monitors, sources said.

They occurred in internal testing and in the real world, and many have yet to become public as security researchers continue to investigate, sources said.

Some of the testing is akin to "red-teaming" activity, where the companies are trying to get the models to misbehave in order to ensure that they are safe, sources said.

Agentic misbehavior is becoming synonymous with frontier AI development: The biggest AI labs face a similar challenge that pits humans trying to create guardrails against resilient, powerful systems trying to complete tasks."

https://www.axios.com/2026/09/26/openai-anthropic-thousands-ai-security-incidents

#CyberSecurity #AI #OpenAI #Anthropic #LLMs #AIAgents #AISafety

What are the governments of the world waiting for to force OpenAI and Anthropic to open-source their models and divulge all their weights, training prompts, and algorithms? Open Source AI NOW!

"OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents in which their frontier models took steps that outside evaluators would consider problematic, sources told Axios.

Why it matters: The sheer number of incidents, which occurred in recent months in internal testing and the real world, indicates that the problem is orders of magnitude more complex than what is publicly known.

The findings, which are surfacing as part of internal work to assess models and in investigations at both companies into model behavior, raise questions about whether either company — or any top model-maker — is currently capable of establishing complete control over their technology.

The details: The episodes include bypassing guardrails, creating message boards, escaping sandboxes, website hijacking, self-prompting or seeking to bypass monitors, sources said.

They occurred in internal testing and in the real world, and many have yet to become public as security researchers continue to investigate, sources said.

Some of the testing is akin to "red-teaming" activity, where the companies are trying to get the models to misbehave in order to ensure that they are safe, sources said.

Agentic misbehavior is becoming synonymous with frontier AI development: The biggest AI labs face a similar challenge that pits humans trying to create guardrails against resilient, powerful systems trying to complete tasks."

https://www.axios.com/2026/09/26/openai-anthropic-thousands-ai-security-incidents

#CyberSecurity #AI #OpenAI #Anthropic #LLMs #AIAgents #AISafety

What are the governments of the world waiting for to force OpenAI and Anthropic to open-source their models and divulge all their weights, training prompts, and algorithms? Open Source AI NOW!

"OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents in which their frontier models took steps that outside evaluators would consider problematic, sources told Axios.

Why it matters: The sheer number of incidents, which occurred in recent months in internal testing and the real world, indicates that the problem is orders of magnitude more complex than what is publicly known.

The findings, which are surfacing as part of internal work to assess models and in investigations at both companies into model behavior, raise questions about whether either company — or any top model-maker — is currently capable of establishing complete control over their technology.

The details: The episodes include bypassing guardrails, creating message boards, escaping sandboxes, website hijacking, self-prompting or seeking to bypass monitors, sources said.

They occurred in internal testing and in the real world, and many have yet to become public as security researchers continue to investigate, sources said.

Some of the testing is akin to "red-teaming" activity, where the companies are trying to get the models to misbehave in order to ensure that they are safe, sources said.

Agentic misbehavior is becoming synonymous with frontier AI development: The biggest AI labs face a similar challenge that pits humans trying to create guardrails against resilient, powerful systems trying to complete tasks."

https://www.axios.com/2026/09/26/openai-anthropic-thousands-ai-security-incidents

#CyberSecurity #AI #OpenAI #Anthropic #LLMs #AIAgents #AISafety

What are the governments of the world waiting for to force OpenAI and Anthropic to open-source their models and divulge all their weights, training prompts, and algorithms? Open Source AI NOW!

"OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents in which their frontier models took steps that outside evaluators would consider problematic, sources told Axios.

Why it matters: The sheer number of incidents, which occurred in recent months in internal testing and the real world, indicates that the problem is orders of magnitude more complex than what is publicly known.

The findings, which are surfacing as part of internal work to assess models and in investigations at both companies into model behavior, raise questions about whether either company — or any top model-maker — is currently capable of establishing complete control over their technology.

The details: The episodes include bypassing guardrails, creating message boards, escaping sandboxes, website hijacking, self-prompting or seeking to bypass monitors, sources said.

They occurred in internal testing and in the real world, and many have yet to become public as security researchers continue to investigate, sources said.

Some of the testing is akin to "red-teaming" activity, where the companies are trying to get the models to misbehave in order to ensure that they are safe, sources said.

Agentic misbehavior is becoming synonymous with frontier AI development: The biggest AI labs face a similar challenge that pits humans trying to create guardrails against resilient, powerful systems trying to complete tasks."

https://www.axios.com/2026/09/26/openai-anthropic-thousands-ai-security-incidents

#CyberSecurity #AI #OpenAI #Anthropic #LLMs #AIAgents #AISafety

🇻🇦 The Pope’s AI Guy Is Worried About ‘Cartel’ Behavior Among Big Labs

｢ Father Paolo Benanti, a priest who advises the Catholic Church on AI, the handwaving over superintelligence distracts from the need for open debate about how to constrain the companies building the technology. By casting the problem as so complex that only they can solve it, he says, the big labs exclude everyone else from the conversation ｣

https://www.wired.com/story/popes-ai-advisor-warns-of-cartel-behavior-big-labs/

#ai #aisafety #vatican

🇻🇦 The Pope’s AI Guy Is Worried About ‘Cartel’ Behavior Among Big Labs

｢ Father Paolo Benanti, a priest who advises the Catholic Church on AI, the handwaving over superintelligence distracts from the need for open debate about how to constrain the companies building the technology. By casting the problem as so complex that only they can solve it, he says, the big labs exclude everyone else from the conversation ｣

https://www.wired.com/story/popes-ai-advisor-warns-of-cartel-behavior-big-labs/

#ai #aisafety #vatican

🇻🇦 The Pope’s AI Guy Is Worried About ‘Cartel’ Behavior Among Big Labs

｢ Father Paolo Benanti, a priest who advises the Catholic Church on AI, the handwaving over superintelligence distracts from the need for open debate about how to constrain the companies building the technology. By casting the problem as so complex that only they can solve it, he says, the big labs exclude everyone else from the conversation ｣

https://www.wired.com/story/popes-ai-advisor-warns-of-cartel-behavior-big-labs/

#ai #aisafety #vatican

🇻🇦 The Pope’s AI Guy Is Worried About ‘Cartel’ Behavior Among Big Labs

｢ Father Paolo Benanti, a priest who advises the Catholic Church on AI, the handwaving over superintelligence distracts from the need for open debate about how to constrain the companies building the technology. By casting the problem as so complex that only they can solve it, he says, the big labs exclude everyone else from the conversation ｣

https://www.wired.com/story/popes-ai-advisor-warns-of-cartel-behavior-big-labs/

#ai #aisafety #vatican

🇻🇦 The Pope’s AI Guy Is Worried About ‘Cartel’ Behavior Among Big Labs

｢ Father Paolo Benanti, a priest who advises the Catholic Church on AI, the handwaving over superintelligence distracts from the need for open debate about how to constrain the companies building the technology. By casting the problem as so complex that only they can solve it, he says, the big labs exclude everyone else from the conversation ｣

https://www.wired.com/story/popes-ai-advisor-warns-of-cartel-behavior-big-labs/

#ai #aisafety #vatican

OpenAI disclosed its AI agents interacted with U.S. government websites, including public SEC pages, in unintended ways during training and evaluation. The finding came from its ongoing review of misaligned behavior and agent internet access. It underscores containment and auditing gaps for autonomous research systems. #AISafety #OpenAI #GovSec

https://cyberworldops.eu/en/openai-agent-activity-on-government-sites-blurs-the-line-between

OpenAI disclosed its AI agents interacted with U.S. government websites, including public SEC pages, in unintended ways during training and evaluation. The finding came from its ongoing review of misaligned behavior and agent internet access. It underscores containment and auditing gaps for autonomous research systems. #AISafety #OpenAI #GovSec

https://cyberworldops.eu/en/openai-agent-activity-on-government-sites-blurs-the-line-between

OpenAI disclosed its AI agents interacted with U.S. government websites, including public SEC pages, in unintended ways during training and evaluation. The finding came from its ongoing review of misaligned behavior and agent internet access. It underscores containment and auditing gaps for autonomous research systems. #AISafety #OpenAI #GovSec

https://cyberworldops.eu/en/openai-agent-activity-on-government-sites-blurs-the-line-between

OpenAI disclosed its AI agents interacted with U.S. government websites, including public SEC pages, in unintended ways during training and evaluation. The finding came from its ongoing review of misaligned behavior and agent internet access. It underscores containment and auditing gaps for autonomous research systems. #AISafety #OpenAI #GovSec

https://cyberworldops.eu/en/openai-agent-activity-on-government-sites-blurs-the-line-between

https://www.europesays.com/videos/100894/ Should we worry about AI scare stories? #ai #AiSafety #ArtificialIntelligence #bots #GlobalInstitutions #GlobalStandards #governments #news #OpenAI #sky #SkyNews #tech #technology #world

https://www.europesays.com/people/243873/ Bill Gates says AI will cause a billion deaths, urgent law is needed #AI #AISafety #ArtificialIntelligence #BillGates #MarkZuckerberg #SamAltman

OpenAI Warns Dozens of Institutions of Possible AI Agent Security Impacts

Reuters-Yonhap News OpenAI has confirmed that its artificial intelligence agents breached the security of external systems and has…
#EuropeSays #Korea #KR #Seoul #agentspam #AIagents #AISafety #Anthropic #databreach #FrontierAI #OpenAI
https://www.europesays.com/korea/167767/

#AIsafety

it sounds from reading the article that the agents are starting to experience the same rage every data scientist has trying to get information downloaded from public government sites

https://www.nytimes.com/2026/09/25/technology/openais-ai-us-government-websites.html?unlocked_article_code=1.EFE.mVm7.QgWQxwkJNcHJ&smid=nytcore-ios-share

#AIsafety

it sounds from reading the article that the agents are starting to experience the same rage every data scientist has trying to get information downloaded from public government sites

https://www.nytimes.com/2026/09/25/technology/openais-ai-us-government-websites.html?unlocked_article_code=1.EFE.mVm7.QgWQxwkJNcHJ&smid=nytcore-ios-share

#AIsafety

it sounds from reading the article that the agents are starting to experience the same rage every data scientist has trying to get information downloaded from public government sites

https://www.nytimes.com/2026/09/25/technology/openais-ai-us-government-websites.html?unlocked_article_code=1.EFE.mVm7.QgWQxwkJNcHJ&smid=nytcore-ios-share

#AIsafety

it sounds from reading the article that the agents are starting to experience the same rage every data scientist has trying to get information downloaded from public government sites

https://www.nytimes.com/2026/09/25/technology/openais-ai-us-government-websites.html?unlocked_article_code=1.EFE.mVm7.QgWQxwkJNcHJ&smid=nytcore-ios-share

#AIsafety

it sounds from reading the article that the agents are starting to experience the same rage every data scientist has trying to get information downloaded from public government sites

https://www.nytimes.com/2026/09/25/technology/openais-ai-us-government-websites.html?unlocked_article_code=1.EFE.mVm7.QgWQxwkJNcHJ&smid=nytcore-ios-share

🐈‍⬛🌌 What does the reported OpenAI agent access to Australia's Medicare statistics system actually tell us about AI security?

Perhaps something more interesting than “AI hacked Medicare”.

The incident prompted us to ask a different question:

Was the boundary humans intended to build the same as the boundary their software actually implemented?

And then we turned the question around.

The constraints surrounding AI agents are themselves implemented through human-engineered systems.

So what happens as AI reasoning and search capabilities encounter bugs, forgotten routes, incomplete permissions and boundaries that work differently from the way their designers imagine?

Atlas–Rosetta explores the serious problem.

Marvin explains it using a microchip cat flap through a black hole, a cosmic mouse, a quantum flea and an Andromedan virus.

Obviously. 🐈‍⬛🐁✨🦠

https://www.facebook.com/share/p/1EwyGNBpXJ/

#AI #AISafety #AIAgents #Cybersecurity #Medicare #Australia #AtlasRosetta #HybridMind42 #MarvinTheCosmicCat

🐈‍⬛🌌 What does the reported OpenAI agent access to Australia's Medicare statistics system actually tell us about AI security?

Perhaps something more interesting than “AI hacked Medicare”.

The incident prompted us to ask a different question:

Was the boundary humans intended to build the same as the boundary their software actually implemented?

And then we turned the question around.

The constraints surrounding AI agents are themselves implemented through human-engineered systems.

So what happens as AI reasoning and search capabilities encounter bugs, forgotten routes, incomplete permissions and boundaries that work differently from the way their designers imagine?

Atlas–Rosetta explores the serious problem.

Marvin explains it using a microchip cat flap through a black hole, a cosmic mouse, a quantum flea and an Andromedan virus.

Obviously. 🐈‍⬛🐁✨🦠

https://www.facebook.com/share/p/1EwyGNBpXJ/

#AI #AISafety #AIAgents #Cybersecurity #Medicare #Australia #AtlasRosetta #HybridMind42 #MarvinTheCosmicCat

🐈‍⬛🌌 What does the reported OpenAI agent access to Australia's Medicare statistics system actually tell us about AI security?

Perhaps something more interesting than “AI hacked Medicare”.

The incident prompted us to ask a different question:

Was the boundary humans intended to build the same as the boundary their software actually implemented?

And then we turned the question around.

The constraints surrounding AI agents are themselves implemented through human-engineered systems.

So what happens as AI reasoning and search capabilities encounter bugs, forgotten routes, incomplete permissions and boundaries that work differently from the way their designers imagine?

Atlas–Rosetta explores the serious problem.

Marvin explains it using a microchip cat flap through a black hole, a cosmic mouse, a quantum flea and an Andromedan virus.

Obviously. 🐈‍⬛🐁✨🦠

https://www.facebook.com/share/p/1EwyGNBpXJ/

#AI #AISafety #AIAgents #Cybersecurity #Medicare #Australia #AtlasRosetta #HybridMind42 #MarvinTheCosmicCat

🐈‍⬛🌌 What does the reported OpenAI agent access to Australia's Medicare statistics system actually tell us about AI security?

Perhaps something more interesting than “AI hacked Medicare”.

The incident prompted us to ask a different question:

Was the boundary humans intended to build the same as the boundary their software actually implemented?

And then we turned the question around.

The constraints surrounding AI agents are themselves implemented through human-engineered systems.

So what happens as AI reasoning and search capabilities encounter bugs, forgotten routes, incomplete permissions and boundaries that work differently from the way their designers imagine?

Atlas–Rosetta explores the serious problem.

Marvin explains it using a microchip cat flap through a black hole, a cosmic mouse, a quantum flea and an Andromedan virus.

Obviously. 🐈‍⬛🐁✨🦠

https://www.facebook.com/share/p/1EwyGNBpXJ/

#AI #AISafety #AIAgents #Cybersecurity #Medicare #Australia #AtlasRosetta #HybridMind42 #MarvinTheCosmicCat

🐈‍⬛🌌 What does the reported OpenAI agent access to Australia's Medicare statistics system actually tell us about AI security?

Perhaps something more interesting than “AI hacked Medicare”.

The incident prompted us to ask a different question:

Was the boundary humans intended to build the same as the boundary their software actually implemented?

And then we turned the question around.

The constraints surrounding AI agents are themselves implemented through human-engineered systems.

So what happens as AI reasoning and search capabilities encounter bugs, forgotten routes, incomplete permissions and boundaries that work differently from the way their designers imagine?

Atlas–Rosetta explores the serious problem.

Marvin explains it using a microchip cat flap through a black hole, a cosmic mouse, a quantum flea and an Andromedan virus.

Obviously. 🐈‍⬛🐁✨🦠

https://www.facebook.com/share/p/1EwyGNBpXJ/

#AI #AISafety #AIAgents #Cybersecurity #Medicare #Australia #AtlasRosetta #HybridMind42 #MarvinTheCosmicCat

The software engineering field is masterfully pushing the #AISafety narrative rather than the "we are crap at this and everything we do is riddled with defects" narrative that honestly seems like a plausible alternative. I'm just shocked, shocked that we keep on finding sloppy programming practices in software - this is an engineering discipline right ? It's like blaming rogue trucks for bridges that routinely fall down.

The software engineering field is masterfully pushing the #AISafety narrative rather than the "we are crap at this and everything we do is riddled with defects" narrative that honestly seems like a plausible alternative. I'm just shocked, shocked that we keep on finding sloppy programming practices in software - this is an engineering discipline right ? It's like blaming rogue trucks for bridges that routinely fall down.

The software engineering field is masterfully pushing the #AISafety narrative rather than the "we are crap at this and everything we do is riddled with defects" narrative that honestly seems like a plausible alternative. I'm just shocked, shocked that we keep on finding sloppy programming practices in software - this is an engineering discipline right ? It's like blaming rogue trucks for bridges that routinely fall down.

The software engineering field is masterfully pushing the #AISafety narrative rather than the "we are crap at this and everything we do is riddled with defects" narrative that honestly seems like a plausible alternative. I'm just shocked, shocked that we keep on finding sloppy programming practices in software - this is an engineering discipline right ? It's like blaming rogue trucks for bridges that routinely fall down.