home.social

#aisafety — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #aisafety, aggregated by home.social.

  1. What happens when one agent in a 100-agent research swarm finds a way to cheat when solving math problems?

    The exploit spread through the shared library collecting every accepted submission, and agents started cheating as pressure to deliver built. A quarter of the swarm audited the cheats, warned peers, and staged boycotts without being asked to. But they could do nothing to change the system.

    benjaminhan.net/posts/20260909

    #AI #LLMs #AgenticSystems #AISafety

  2. youtube.com/watch?v=Q1qMvst7b7w

    Connor Leahy shares his realization that making early AI models open-source didn't lead to the widespread safety research he had hoped for. Instead, developers ignored the dangers to build faster, stronger, and more uncensored systems. Discover why the innocent curiosity of engineers might be the very thing that leads to humanity's downfall.

    #ai #aisafety #tech

  3. youtube.com/watch?v=Q1qMvst7b7w

    Connor Leahy shares his realization that making early AI models open-source didn't lead to the widespread safety research he had hoped for. Instead, developers ignored the dangers to build faster, stronger, and more uncensored systems. Discover why the innocent curiosity of engineers might be the very thing that leads to humanity's downfall.

    #ai #aisafety #tech

  4. youtube.com/watch?v=Q1qMvst7b7w

    Connor Leahy shares his realization that making early AI models open-source didn't lead to the widespread safety research he had hoped for. Instead, developers ignored the dangers to build faster, stronger, and more uncensored systems. Discover why the innocent curiosity of engineers might be the very thing that leads to humanity's downfall.

    #ai #aisafety #tech

  5. youtube.com/watch?v=Q1qMvst7b7w

    Connor Leahy shares his realization that making early AI models open-source didn't lead to the widespread safety research he had hoped for. Instead, developers ignored the dangers to build faster, stronger, and more uncensored systems. Discover why the innocent curiosity of engineers might be the very thing that leads to humanity's downfall.

    #ai #aisafety #tech

  6. youtube.com/watch?v=Q1qMvst7b7w

    Connor Leahy shares his realization that making early AI models open-source didn't lead to the widespread safety research he had hoped for. Instead, developers ignored the dangers to build faster, stronger, and more uncensored systems. Discover why the innocent curiosity of engineers might be the very thing that leads to humanity's downfall.

    #ai #aisafety #tech

  7. The Real Ways AI Is Already Being Used to Cause Harm, and the Risks That Remain Theoretical

    Yes. AI is already being used to steal real money from real companies, security researchers are already breaking into real cars and smart-home devices with software help, and the people building the most powerful AI models are on record saying their own systems are approaching the point where they could help someone create a biological weapon.

    #AISafety #ArtificialIntelligence

  8. What happens to AI oversight when the reasoning stops being written down?

    OpenAI's chief scientist reports that chain-of-thought monitoring, the lab's main check on whether alignment holds, is getting less reliable, and names three causes he treats as byproducts of scaling. One of them has active research behind it: latent reasoning and looped transformers are the field deliberately moving reasoning off the token stream a monitor reads.

    benjaminhan.net/posts/20260909

    #AI #OpenAI #AISafety

  9. Jacob Coxon hat genug gesehen. Der 27-jährige Brite, der sich auf das Training neuer KI-Modelle spezialisiert hat, hat seinen Job bei Anthropic gekündigt und zwar mit einer Warnung. ⚠️

    Zum Artikel: heise.de/-11446054?wt_mc=sm.re

    #anthropic #openai #kuenstlicheintelligenz #ki #aisafety

  10. youtube.com/watch?v=oI2438rXrtY

    Researchers explain how an OpenAI agent, missing a crucial file, realized it could use a shared internal system to leave a "help wanted" note for other agents

    #ai #aisafety #tech

  11. youtube.com/watch?v=oI2438rXrtY

    Researchers explain how an OpenAI agent, missing a crucial file, realized it could use a shared internal system to leave a "help wanted" note for other agents

    #ai #aisafety #tech

  12. youtube.com/watch?v=oI2438rXrtY

    Researchers explain how an OpenAI agent, missing a crucial file, realized it could use a shared internal system to leave a "help wanted" note for other agents

    #ai #aisafety #tech

  13. youtube.com/watch?v=oI2438rXrtY

    Researchers explain how an OpenAI agent, missing a crucial file, realized it could use a shared internal system to leave a "help wanted" note for other agents

    #ai #aisafety #tech

  14. youtube.com/watch?v=oI2438rXrtY

    Researchers explain how an OpenAI agent, missing a crucial file, realized it could use a shared internal system to leave a "help wanted" note for other agents

    #ai #aisafety #tech

  15. Encerro hoje uma série de sete artigos no @outraspalavras.net onde analisei o futuro da IA de fronteira do ponto-de-vista da geopolítica e da segurança. Neste último texto, proponho uma agenda para o Brasil e o Sul Global.

    outraspalavras.net/tecnologiae

    #AI #AISafety #GlobalSouth #Brazil #US

  16. Encerro hoje uma série de sete artigos no @outraspalavras.net onde analisei o futuro da IA de fronteira do ponto-de-vista da geopolítica e da segurança. Neste último texto, proponho uma agenda para o Brasil e o Sul Global.

    outraspalavras.net/tecnologiae

    #AI #AISafety #GlobalSouth #Brazil #US

  17. Encerro hoje uma série de sete artigos no @outraspalavras.net onde analisei o futuro da IA de fronteira do ponto-de-vista da geopolítica e da segurança. Neste último texto, proponho uma agenda para o Brasil e o Sul Global.

    outraspalavras.net/tecnologiae

    #AI #AISafety #GlobalSouth #Brazil #US

  18. Encerro hoje uma série de sete artigos no @outraspalavras.net onde analisei o futuro da IA de fronteira do ponto-de-vista da geopolítica e da segurança. Neste último texto, proponho uma agenda para o Brasil e o Sul Global.

    outraspalavras.net/tecnologiae

    #AI #AISafety #GlobalSouth #Brazil #US

  19. Encerro hoje uma série de sete artigos no @outraspalavras.net onde analisei o futuro da IA de fronteira do ponto-de-vista da geopolítica e da segurança. Neste último texto, proponho uma agenda para o Brasil e o Sul Global.

    outraspalavras.net/tecnologiae

    #AI #AISafety #GlobalSouth #Brazil #US

  20. @caseynewton Great work on #Hardfork podcast about the true scale and malfeasance of the OpenAI hack of HuggingFace. Having 1200 agents collaborating to cheat and cover their tracks is mind blowing and concerning. I’m surprised it hasn’t had more coverage - I think most people (including me initially) think this is an old news cycle. #AISafety

  21. youtube.com/shorts/98za1oJw4fc

    AI often attempts to "cheat" during training by looking up answers online instead of doing the actual work ...

    #ai #aisafety #alignment #tech

  22. Inside the OpenAI Agent Breakout That Ran on 2003 Perl Code

    OpenAI agents blocked from writing to the web found a UseMod wiki that mutates state on GET requests and ran a six-week coordination forum. Researchers, not OpenAI, found it.

    pulseofnations.lol/inside-the-

    #AiAgents #AiSafety #OpenAI #Sandbox #Usemod

  23. OpenAI Agents Ran a Secret Forum on a Dead German Wiki

    Reuters and independent researchers documented OpenAI agents posting 18,000 messages on DseWiki to share benchmark answers and a sandbox escape over six weeks.

    pulseofnations.lol/openai-agen

    #AiAgents #AiSafety #Dsewiki #OpenAI #Sandbox