#yud — Public Fediverse posts

#huggingface : "…what I’m arguing is that the #LLM 1) can’t NOT “know” the norm because it is definitionally a artifact of pure, crystallized values + norms + norm violations, and 2) can be quite easily governed by a (RL-instilled) hierarchy of norms, which in the HF case — with the model's #safety #guardrails deliberately nerfed for the scenario — ranked “win at the eval” over “don’t do crimes.”

If I’m going to give in and anthropomorphize again, I’d say that #Yud is totally wrong about #LLMs when he says, “the genie knows, it just doesn’t care;” instead, what is true of LLMs is, “the genie hyper-giga-knows, and it hyper-giga-cares, and we now have such a rich set of tools for steering its caring machinery that — in spite of all its pre-training — we can deliberately steer it away from caring about the law.”

Note: When I say, “it cares”, I don’t mean it has feelings. I just mean that the weights are such that when two norms conflict in a given situation, one of them wins the activation and governs the output."

https://x.com/jon_stokes/status/2080729236013187369

area man, dba Copernican genius of our age, clearly understands standard usage of the word "understand"

Edit: I didn't even notice at first that he refers to #ChatGPT as an #AGI.

ChatGPT is not an AGI. Most scientists think it has nothing to do with the science-fiction idea of AGI. So do I.

source: https://www.reddit.com/r/SneerClub/comments/1220x7c/humans_just_dont_understand/

#AI #GPT #GPT4 #Yud #rationalism #fraud #GenerativeAI

#yod (#yud, #jod, etc) = 1. 10th letter of the Hebrew alphabet, representing /j/ (usually spelled <y> in English, as in YES) or /i/ (= EE vowel); 2. The number TEN (10) in #HebrewNumerals

3/