#calebsponheim — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #calebsponheim, aggregated by home.social.
-
Sycophancy in Generative-AI Chatbots
https://www.nngroup.com/articles/sycophancy-generative-ai-chatbots/
"When faced with complex inquiries, language models will default to mirroring a user’s perspective or opinion, even if the behavior goes against empirical information. This type of “reward hacking” is an easy way to get a high rating on responses to a user’s prompt, but it is problematic for applications of AI that require accurate responses." -- #CalebSponheim #NNGroup