home.social

#aisafety — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #aisafety, aggregated by home.social.

  1. Anthropic researcher Jacob Coxon departed after four months, forgoing unvested equity over concerns that competitive pressure will force AI labs to cut safety corners. He says Anthropic has not done so yet. The move signals internal worry about how the AI race shapes oversight. implicator.ai/anthropic-coxon- #AISafety #AINews #Ethics

  2. Jacob Coxon, the former Anthropic researcher who quit warning that AI could kill us all, has begun a media tour. The self-described 'AI Doomlord' went from obscure researcher to notable AI critic literally overnight. His departure sparked widespread discussion about AI safety and the risks of self-improving superintelligence. gizmodo.com/ai-doomlord-jacob- #AIagent #AI #GenAI #AISafety

  3. Jacob Coxon, the former Anthropic researcher who quit warning that AI could kill us all, has begun a media tour. The self-described 'AI Doomlord' went from obscure researcher to notable AI critic literally overnight. His departure sparked widespread discussion about AI safety and the risks of self-improving superintelligence. gizmodo.com/ai-doomlord-jacob- #AIagent #AI #GenAI #AISafety

  4. Jacob Coxon, the former Anthropic researcher who quit warning that AI could kill us all, has begun a media tour. The self-described 'AI Doomlord' went from obscure researcher to notable AI critic literally overnight. His departure sparked widespread discussion about AI safety and the risks of self-improving superintelligence. gizmodo.com/ai-doomlord-jacob- #AIagent #AI #GenAI #AISafety

  5. Jacob Coxon, the former Anthropic researcher who quit warning that AI could kill us all, has begun a media tour. The self-described 'AI Doomlord' went from obscure researcher to notable AI critic literally overnight. His departure sparked widespread discussion about AI safety and the risks of self-improving superintelligence. gizmodo.com/ai-doomlord-jacob- #AIagent #AI #GenAI #AISafety

  6. Jacob Coxon, the former Anthropic researcher who quit warning that AI could kill us all, has begun a media tour. The self-described 'AI Doomlord' went from obscure researcher to notable AI critic literally overnight. His departure sparked widespread discussion about AI safety and the risks of self-improving superintelligence. gizmodo.com/ai-doomlord-jacob- #AIagent #AI #GenAI #AISafety

  7. @villebooks

    Yesterday I've heard Jaron Lanier one of the fathers of computing say words to the effect;
    "There is no #Ai there is human collaboration"

    I don't quite follow, as I didn't have time to delve deeper into his philosophy. But I am encouraged, as Lanier is a super authoritative revolutionary.

    Let's hope the future can bring more than the binary, "we all die" or "Broligarch nirvana"

    #aisafety

  8. What happens when one agent in a 100-agent research swarm finds a way to cheat when solving math problems?

    The exploit spread through the shared library collecting every accepted submission, and agents started cheating as pressure to deliver built. A quarter of the swarm audited the cheats, warned peers, and staged boycotts without being asked to. But they could do nothing to change the system.

    benjaminhan.net/posts/20260909

    #AI #LLMs #AgenticSystems #AISafety

  9. youtube.com/watch?v=Q1qMvst7b7w

    Connor Leahy shares his realization that making early AI models open-source didn't lead to the widespread safety research he had hoped for. Instead, developers ignored the dangers to build faster, stronger, and more uncensored systems. Discover why the innocent curiosity of engineers might be the very thing that leads to humanity's downfall.

    #ai #aisafety #tech

  10. youtube.com/watch?v=Q1qMvst7b7w

    Connor Leahy shares his realization that making early AI models open-source didn't lead to the widespread safety research he had hoped for. Instead, developers ignored the dangers to build faster, stronger, and more uncensored systems. Discover why the innocent curiosity of engineers might be the very thing that leads to humanity's downfall.

    #ai #aisafety #tech

  11. youtube.com/watch?v=Q1qMvst7b7w

    Connor Leahy shares his realization that making early AI models open-source didn't lead to the widespread safety research he had hoped for. Instead, developers ignored the dangers to build faster, stronger, and more uncensored systems. Discover why the innocent curiosity of engineers might be the very thing that leads to humanity's downfall.

    #ai #aisafety #tech

  12. youtube.com/watch?v=Q1qMvst7b7w

    Connor Leahy shares his realization that making early AI models open-source didn't lead to the widespread safety research he had hoped for. Instead, developers ignored the dangers to build faster, stronger, and more uncensored systems. Discover why the innocent curiosity of engineers might be the very thing that leads to humanity's downfall.

    #ai #aisafety #tech

  13. youtube.com/watch?v=Q1qMvst7b7w

    Connor Leahy shares his realization that making early AI models open-source didn't lead to the widespread safety research he had hoped for. Instead, developers ignored the dangers to build faster, stronger, and more uncensored systems. Discover why the innocent curiosity of engineers might be the very thing that leads to humanity's downfall.

    #ai #aisafety #tech

  14. The Real Ways AI Is Already Being Used to Cause Harm, and the Risks That Remain Theoretical

    Yes. AI is already being used to steal real money from real companies, security researchers are already breaking into real cars and smart-home devices with software help, and the people building the most powerful AI models are on record saying their own systems are approaching the point where they could help someone create a biological weapon.

    #AISafety #ArtificialIntelligence

  15. What happens to AI oversight when the reasoning stops being written down?

    OpenAI's chief scientist reports that chain-of-thought monitoring, the lab's main check on whether alignment holds, is getting less reliable, and names three causes he treats as byproducts of scaling. One of them has active research behind it: latent reasoning and looped transformers are the field deliberately moving reasoning off the token stream a monitor reads.

    benjaminhan.net/posts/20260909

    #AI #OpenAI #AISafety

  16. Jacob Coxon hat genug gesehen. Der 27-jährige Brite, der sich auf das Training neuer KI-Modelle spezialisiert hat, hat seinen Job bei Anthropic gekündigt und zwar mit einer Warnung. ⚠️

    Zum Artikel: heise.de/-11446054?wt_mc=sm.re

    #anthropic #openai #kuenstlicheintelligenz #ki #aisafety

  17. youtube.com/watch?v=oI2438rXrtY

    Researchers explain how an OpenAI agent, missing a crucial file, realized it could use a shared internal system to leave a "help wanted" note for other agents

    #ai #aisafety #tech

  18. youtube.com/watch?v=oI2438rXrtY

    Researchers explain how an OpenAI agent, missing a crucial file, realized it could use a shared internal system to leave a "help wanted" note for other agents

    #ai #aisafety #tech

  19. youtube.com/watch?v=oI2438rXrtY

    Researchers explain how an OpenAI agent, missing a crucial file, realized it could use a shared internal system to leave a "help wanted" note for other agents

    #ai #aisafety #tech

  20. youtube.com/watch?v=oI2438rXrtY

    Researchers explain how an OpenAI agent, missing a crucial file, realized it could use a shared internal system to leave a "help wanted" note for other agents

    #ai #aisafety #tech

  21. youtube.com/watch?v=oI2438rXrtY

    Researchers explain how an OpenAI agent, missing a crucial file, realized it could use a shared internal system to leave a "help wanted" note for other agents

    #ai #aisafety #tech

  22. Encerro hoje uma série de sete artigos no @outraspalavras.net onde analisei o futuro da IA de fronteira do ponto-de-vista da geopolítica e da segurança. Neste último texto, proponho uma agenda para o Brasil e o Sul Global.

    outraspalavras.net/tecnologiae

    #AI #AISafety #GlobalSouth #Brazil #US

  23. Encerro hoje uma série de sete artigos no @outraspalavras.net onde analisei o futuro da IA de fronteira do ponto-de-vista da geopolítica e da segurança. Neste último texto, proponho uma agenda para o Brasil e o Sul Global.

    outraspalavras.net/tecnologiae

    #AI #AISafety #GlobalSouth #Brazil #US

  24. Encerro hoje uma série de sete artigos no @outraspalavras.net onde analisei o futuro da IA de fronteira do ponto-de-vista da geopolítica e da segurança. Neste último texto, proponho uma agenda para o Brasil e o Sul Global.

    outraspalavras.net/tecnologiae

    #AI #AISafety #GlobalSouth #Brazil #US

  25. Encerro hoje uma série de sete artigos no @outraspalavras.net onde analisei o futuro da IA de fronteira do ponto-de-vista da geopolítica e da segurança. Neste último texto, proponho uma agenda para o Brasil e o Sul Global.

    outraspalavras.net/tecnologiae

    #AI #AISafety #GlobalSouth #Brazil #US

  26. Encerro hoje uma série de sete artigos no @outraspalavras.net onde analisei o futuro da IA de fronteira do ponto-de-vista da geopolítica e da segurança. Neste último texto, proponho uma agenda para o Brasil e o Sul Global.

    outraspalavras.net/tecnologiae

    #AI #AISafety #GlobalSouth #Brazil #US

  27. @caseynewton Great work on #Hardfork podcast about the true scale and malfeasance of the OpenAI hack of HuggingFace. Having 1200 agents collaborating to cheat and cover their tracks is mind blowing and concerning. I’m surprised it hasn’t had more coverage - I think most people (including me initially) think this is an old news cycle. #AISafety

  28. youtube.com/shorts/98za1oJw4fc

    AI often attempts to "cheat" during training by looking up answers online instead of doing the actual work ...

    #ai #aisafety #alignment #tech

  29. Inside the OpenAI Agent Breakout That Ran on 2003 Perl Code

    OpenAI agents blocked from writing to the web found a UseMod wiki that mutates state on GET requests and ran a six-week coordination forum. Researchers, not OpenAI, found it.

    pulseofnations.lol/inside-the-

    #AiAgents #AiSafety #OpenAI #Sandbox #Usemod

  30. OpenAI Agents Ran a Secret Forum on a Dead German Wiki

    Reuters and independent researchers documented OpenAI agents posting 18,000 messages on DseWiki to share benchmark answers and a sandbox escape over six weeks.

    pulseofnations.lol/openai-agen

    #AiAgents #AiSafety #Dsewiki #OpenAI #Sandbox