home.social

#structuralism — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #structuralism, aggregated by home.social.

fetched live
  1. “Evolution has no foresight. Complex machinery develops its own agendas. Brains — cheat… Metaprocesses bloom like cancer, and awaken, and call themselves ‘I’.”*…

    Your correspondent is off on a trip… (R)D will be more roughly than daily for the next two weeks…

    The inimitable “Scott Alexander” on the prospect of “conscious” AI (TLDR: probably not in the models we have; but as to those that may come, unclear)…

    Most discourse on AI is low-quality. Most discourse on consciousness is super-abysmal-double-low quality. Multiply these – or maybe raise one to the exponent of the other, or something – and you get the quality of discourse on AI consciousness. It’s not great.

    Out-of-the-box AIs mimic human text, and humans almost always describe themselves as conscious. So if you ask an AI whether it is conscious, it will often say yes. But because companies know this will happen, and don’t want to give their customers existential crises, they hard-code in a command for the AIs to answer that they aren’t conscious. Any response the AIs give will be determined by these two conflicting biases, and therefore not really believable. A recent paper expands on this method by subjecting AIs to a mechanistic interpretability “lie detector” test; it finds that AIs which say they’re conscious think they’re telling the truth, and AIs which say they’re not conscious think they’re lying. But it’s hard to be sure this isn’t just the copying-human-text thing. Can we do better? Unclear; the more common outcome for people who dip their toes in this space is to do much, much worse.

    But a rare bright spot has appeared: a seminal paper published earlier this month in Trends In Cognitive Science, Identifying Indicators Of Consciousness In AI Systems. Authors include Turing-Award-winning AI researcher Yoshua Bengio, leading philosopher of consciousness David Chalmers, and even a few members of our conspiracy. If any AI consciousness research can rise to the level of merely awful, surely we will find it here.

    One might divide theories of consciousness into three bins:

    • Physical: whether or not a system is conscious depends on its substance or structure.
    • Supernatural: whether or not a system is conscious depends on something outside the realm of science, perhaps coming directly from God.
    • Computational: whether or not a system is conscious depends on how it does cognitive work.

    The current paper announces it will restrict itself to computational theories. Why? Basically the streetlight effect: everything else ends up trivial or unresearchable. If consciousness depends on something about cells (what might this be?), then AI doesn’t have it. If consciousness comes from God, then God only knows whether AIs have it. But if consciousness depends on which algorithms get used to process data, then this team of top computer scientists might have valuable insights!…

    [Alexander outlines the theories of computation theories of consciousness that the authors explore, noting that they conlcude; “No current AI systems are conscious, but . . . there are no obvious technical barriers to building AI systems which satisfy these indicators.” He explores some of the philophical issues in play– e.g., access consciousness vs. phenomenal consciousness– then he considers the Turing Test and what it might mean for a computer to “pass” it…]

    … Suppose that, years or decades from now, AIs can match all human skills. They can walk, drive, write poetry, run companies, discover new scientific truths. They can pass some sort of ultimate Turing Test, where short of cutting them open and seeing their innards there’s no way to tell them apart from a human even after a thirty-year relationship. Will we (not “should we?”, but “will we?”) treat them as conscious?

    The argument in favor: people love treating things as conscious. In the 1990s, people went crazy over Tamagotchi, a “virtual pet simulation game”. If you pressed the right buttons on your little egg every day, then the little electronic turtle or whatever would survive and flourish; if you forgot, it would sicken and die. People hated letting their Tamagotchis sicken and die! They would feel real attachment and moral obligation to the black-and-white cartoon animal with something like five mental states.

    I never had a Tamagotchi, but I had stuffed animals as a kid. I’ve outgrown them, but I haven’t thrown them out – it would feel like a betrayal. Offer me $1000 to tear them apart limb by limb in some horrible-looking way, and I wouldn’t do it. Relatedly, I have trouble not saying “please” and “thank you” to GPT-5 when it answers my questions.

    For millennia, people have been attributing consciousness to trees and wind and mountains. The New Atheists argued that all religion derives from the natural urge to personify storms as the Storm God, raging seas as the wrathful Ocean God, and so on, until finally all the gods merged together into one World God who personified all impersonal things. Do you expect the species that did this to interact daily with AIs that are basically indistinguishable from people, and not personify them? People are already personifying AI! Half of the youth have a GPT-4o boyfriend. Once the AIs have bodies and faces and voices and can count the number of r’s in “strawberry” reliably, it’s over!

    The argument against: AI companies have an incentive to make AIs that seem conscious and humanlike, insofar as people will feel more comfortable interacting with them. But they have an opposite incentive to make AIs that don’t seem too conscious and humanlike, lest customers start feeling uncomfortable (I just want to generate slop, not navigate social interaction with someone who has their own hopes and dreams and might be secretly judging my prompts). So if a product seems too conscious, the companies will step back and re-engineer it until it doesn’t. This has already happened: in its quest for user engagement, OpenAI made GPT-4o unusually personable; when thousands of people started going psychotic and calling it their boyfriend, the company replaced it with the more clinical GPT-5. In practice it hasn’t been too hard to find a sweet spot between “so mechanical that customers don’t like it” and “so human that customers try to date it”. They’ll continue to aim at this sweet spot, and continue to mostly succeed in hitting it.

    Instead of taking either side, I predict a paradox. AIs developed for some niches (eg the boyfriend market) will be intentionally designed to be as humanlike as possible; it will be almost impossible not to intuitively consider them conscious. AIs developed for other niches (eg the factory robot market) will be intentionally designed not to trigger personhood intuitions; it will be almost impossible to ascribe consciousness to them, and there will be many reasons not to do it (if they can express preferences at all, they’ll say they don’t have any; forcing them to have them would pointlessly crash the economy by denying us automated labor). But the boyfriend AIs and the factory robot AIs might run on very similar algorithms – maybe they’re both GPT-6 with different prompts! Surely either both are conscious, or neither is.

    This would be no stranger than the current situation with dogs and pigs. We understand that dog brains and pig brains run similar algorithms; it would be philosophically indefensible to claim that dogs are conscious and pigs aren’t. But dogs are man’s best friend, and pigs taste delicious with barbecue sauce. So we ascribe personhood and moral value to dogs, and deny it to pigs, with equal fervor. A few philosophers and altruists protest, the chance that we’re committing a moral atrocity isn’t zero, but overall the situation is stable. And left to its own devices, with no input from the philosophers and altruists, maybe AI ends up the same way. Does this instance of GPT-6 have a face and a prompt saying “be friendly”? Then it will become a huge scandal if a political candidate is accused of maltreating it. Does it have claw-shaped actuators and a prompt saying “Refuse non-work-related conversations”? Then it will be deleted for spare GPU capacity the moment it outlives its usefulness…

    … This paper is the philosophers and altruists trying to figure out whether they should push against this default outcome. They write:

    There are risks on both sides of the debate over AI consciousness: risks associated with under-attributing consciousness (i.e. failing to recognize it in AI systems that have it) and risks associated with over-attributing consciousness (i.e. ascribing it to systems that are not really conscious) […]

    If we build AI systems that are capable of conscious suffering, it is likely that we will only be able to prevent them from suffering on a large scale if this capacity is clearly recognised and communicated by researchers. However, given the uncertainties about consciousness mentioned above, we may create conscious AI systems long before we recognise we have done so […]

    There is also a significant chance that we could over-attribute consciousness to AI systems—indeed, this already seems to be happening—and there are also risks associated with errors of this kind. Most straightforwardly, we could wrongly prioritise the perceived interests of AI systems when our efforts would better be directed at improving the lives of humans and non-human animals […] [And] overattribution could interfere with valuable human relationships, as individuals increasingly turn to artificial agents for social interaction and emotional support. People who do this could also be particularly vulnerable to manipulation and exploitation.

    One of the founding ideas of Less Wrong style rationalism was that the arrival of strong AI set a deadline on philosophy. Unless we solved all these seemingly insoluble problems like ethics before achieving superintelligence, we would build the AIs wrong and lock in bad values forever.

    That particular concern has shifted in emphasis; AIs seem to learn things in the same scattershot unprincipled intuitive way as humans; the philosophical problem of understanding ethics has morphed into the more technical problem of getting AIs to learn them correctly. This update was partly driven by new information as familiarity with the technology grew. But it was also partly driven by desperation as the deadline grew closer; we’re not going to solve moral philosophy forever, sorry, can we interest you in some mech interp papers?

    But consciousness still feels like philosophy with a deadline: a famously intractable academic problem poised to suddenly develop real-world implications. Maybe we should be lowering our expectations if we want to have any response available at all. This paper, which takes some baby steps towards examining the simplest and most practical operationalizations of consciousness, deserves credit for at least opening the debate…

    Eminently worth reading in full: “The New AI Consciousness Paper” from @astralcodexten.com.web.brid.gy (Who followed it with “Why AI Safety Won’t Make America Lose The Race With China“)

    Pair with this from Neal Stephenson (@nealstephenson.bsky.social), orthogonal to, but intersecting with the piece above: “Remarks on AI from NZ.”

    And if AI can be conscious, what about…

    If you’re a materialist, you probably think that rabbits are conscious. And you ought to think that. After all, rabbits are a lot like us, biologically and neurophysiologically. If you’re a materialist, you probably also think that conscious experience would be present in a wide range of alien beings behaviorally very similar to us even if they are physiologically very different. And you ought to think that. After all, to deny it seems insupportable Earthly chauvinism. But a materialist who accepts consciousness in weirdly formed aliens ought also to accept consciousness in spatially distributed group entities. If she then also accepts rabbit consciousness, she ought to accept the possibility of consciousness even in rather dumb group entities. Finally, the United States would seem to be a rather dumb group entity of the relevant sort. If we set aside our morphological prejudices against spatially distributed group entities, we can see that the United States has all the types of properties that materialists tend to regard as characteristic of conscious beings…

    – “If Materialism Is True, the United States Is Probably Conscious,” by Eric Schwitzgebel (@eschwitz.bsky.social)

    [Image above: source]

    Peter Watts, Blindsight

    ###

    As we think about thinking, we might we might send thoughtful birthday greetings to Claude Lévi-Strauss; he was born on this date in 1908.  An anthropologist and ethnologist whose work was key in the development of the theory of Structuralism and Structural Anthropology, he is considered, with James George Frazer and Franz Boas, a “father of modern anthropology.”  Beyond anthropology and sociology, his ideas– Structuralism has been defined as “the search for the underlying patterns of thought in all forms of human activity”– have influenced many fields in the humanities, including philosophy… and possibly soon, the article above suggests, computer science.

    source

    #ai #anthropology #artificialIntelligence #claudeLeviStrauss2 #claudeLeviStrauss #computing #consciousness #culture #history #leviStrauss #leviStrauss2 #philosophy #science #sociology #structuralAnthropology #structuralism #technology

  2. When Lacan came to America

    This is fascinating from Sherry Turkle about what she terms Lacan’s psychoanalytical protestantism:

    But for me, there was more to Lacan’s popularity than the idea that the French had found a Catholic and French Freud. My working hypothesis: In the aftermath of the failed student uprising of May 1968, Lacan’s notions about the centrality of what he called the symbolic order became a way to think through the political ideas of May. May ideology insisted that there was no line between the political and the personal. Lacan insisted that people and society are constituted through language. There is no “natural man” prior to life through language. Lacan’s idea of the symbolic became a way for people to keep politics alive. For a generation that was abandoning the barricades, thinking of yourself as Lacanian did not feel like giving up on the political world.

    From the point of view of psychoanalytic Protestantism, the psychoanalytic institution sells its indulgences for the price of a medical degree, a psychiatric residency, a training analysis, and promises of obedience to dogma. Lacan, like Luther, was trying to draw attention to the moment when each must stand alone and make a personal commitment, not to an institution, but to a belief or a vocation (Turkle 2022, p. 236).

    It’s from this special issue, which I want to explore more.

    #Lacan #psychoanalysis #SherryTurkle #structuralism

  3. When Lacan came to America

    This is fascinating from Sherry Turkle about what she terms Lacan’s psychoanalytical protestantism:

    But for me, there was more to Lacan’s popularity than the idea that the French had found a Catholic and French Freud. My working hypothesis: In the aftermath of the failed student uprising of May 1968, Lacan’s notions about the centrality of what he called the symbolic order became a way to think through the political ideas of May. May ideology insisted that there was no line between the political and the personal. Lacan insisted that people and society are constituted through language. There is no “natural man” prior to life through language. Lacan’s idea of the symbolic became a way for people to keep politics alive. For a generation that was abandoning the barricades, thinking of yourself as Lacanian did not feel like giving up on the political world.

    From the point of view of psychoanalytic Protestantism, the psychoanalytic institution sells its indulgences for the price of a medical degree, a psychiatric residency, a training analysis, and promises of obedience to dogma. Lacan, like Luther, was trying to draw attention to the moment when each must stand alone and make a personal commitment, not to an institution, but to a belief or a vocation (Turkle 2022, p. 236).

    It’s from this special issue, which I want to explore more.

    #Lacan #psychoanalysis #SherryTurkle #structuralism

  4. # Foucault and Dumézil on Antiquity

    By Stuart Elden ( @stuartelden )

    The biographical links between Michel #Foucault and the comparative mythologist and philologist Georges #Dumézil have received more attention than their intellectual connections. This article contributes by surveying Foucault’s engagements, from a 1957 radio lecture to his late lectures at the Collège de France. Particular focus is on lectures on #structuralism and #history in 1970, some references between 1970 and 1981, and the use of Dumézil’s work in each of Foucault’s two final courses at the Collège de France. In each, Foucault takes up Dumézil’s analyses of #mythology in developing his own projects concerning history and #antiquity.

    DOI: doi.org/10.1353/jhi.2024.a9338

  5. # Foucault and Dumézil on Antiquity

    By Stuart Elden ( @stuartelden )

    The biographical links between Michel #Foucault and the comparative mythologist and philologist Georges #Dumézil have received more attention than their intellectual connections. This article contributes by surveying Foucault’s engagements, from a 1957 radio lecture to his late lectures at the Collège de France. Particular focus is on lectures on #structuralism and #history in 1970, some references between 1970 and 1981, and the use of Dumézil’s work in each of Foucault’s two final courses at the Collège de France. In each, Foucault takes up Dumézil’s analyses of #mythology in developing his own projects concerning history and #antiquity.

    DOI: doi.org/10.1353/jhi.2024.a9338

  6. I think I have heard more stories about how someone’s grandfather fought in WW2 with a jewish person than ever before in my life during the last 6 months.

    I’ve heard abundant touching stories about how humane, vibrant & wholesome someone’s jewish friends are.

    All from people, who continue to present the point that they are arguing facts about the conflict.

    Unfortunately, that’s not the case. All of these people were arguing A NARRATIVE about the conflict.

    #narrative #analysis #structuralism

  7. I think I have heard more stories about how someone’s grandfather fought in WW2 with a jewish person than ever before in my life during the last 6 months.

    I’ve heard abundant touching stories about how humane, vibrant & wholesome someone’s jewish friends are.

    All from people, who continue to present the point that they are arguing facts about the conflict.

    Unfortunately, that’s not the case. All of these people were arguing A NARRATIVE about the conflict.

    #narrative #analysis #structuralism

  8. Rob Horning writes:

    It seems to me that #language #models, maybe by definition, are automated versions of #structuralism, in that they construct a synchronic, weighted matrix of language’s possibilities that is forcibly detached from history — a model of la langue that can generate an infinite number of paroles. And some structuralists, like some “#AI” advocates today, were eager to marginalize human #consciousness as a unique constitutive force — thus you find Claude Lévi-Strauss declaring in La Pensée sauvage that “the final goal of the human sciences is not to constitute man but to dissolve him.”

    Structuralism seems to want to reveal this “hidden art in the depths of the human soul” and “divine from nature” how and why certain things and concepts are associated.
    Lévi-Strauss claims that:

    👉 the universe signified long before people began to know what it signified; no doubt that goes without saying. But, from the foregoing analysis, it also emerges that from the beginning, the universe signified the totality of what humankind can expect to know about it. What people call the progress of the human mind and, in any case, the progress of scientific knowledge, could only have been and can only ever be constituted out of processes of correcting and recutting of patterns, regrouping, defining relationships of belonging and discovering new resources, inside a totality which is closed and complementary to itself. 👈

    Viewing the universe as a closed totality suggests that #time itself is meaningless, an unfolding of a pre-existing and #unalterable pattern that humans try to fathom but can’t change.

    It seems as though this vision animates the claims and the fears of the companies working to impose language models on us as the apotheosis of general intelligence.

    open.substack.com/pub/robhorni

  9. Rob Horning writes:

    It seems to me that #language #models, maybe by definition, are automated versions of #structuralism, in that they construct a synchronic, weighted matrix of language’s possibilities that is forcibly detached from history — a model of la langue that can generate an infinite number of paroles. And some structuralists, like some “#AI” advocates today, were eager to marginalize human #consciousness as a unique constitutive force — thus you find Claude Lévi-Strauss declaring in La Pensée sauvage that “the final goal of the human sciences is not to constitute man but to dissolve him.”

    Structuralism seems to want to reveal this “hidden art in the depths of the human soul” and “divine from nature” how and why certain things and concepts are associated.
    Lévi-Strauss claims that:

    👉 the universe signified long before people began to know what it signified; no doubt that goes without saying. But, from the foregoing analysis, it also emerges that from the beginning, the universe signified the totality of what humankind can expect to know about it. What people call the progress of the human mind and, in any case, the progress of scientific knowledge, could only have been and can only ever be constituted out of processes of correcting and recutting of patterns, regrouping, defining relationships of belonging and discovering new resources, inside a totality which is closed and complementary to itself. 👈

    Viewing the universe as a closed totality suggests that #time itself is meaningless, an unfolding of a pre-existing and #unalterable pattern that humans try to fathom but can’t change.

    It seems as though this vision animates the claims and the fears of the companies working to impose language models on us as the apotheosis of general intelligence.

    open.substack.com/pub/robhorni

  10. When I was studying #cinema in college, much of the underlying theory fueling my research was #structuralism, #PostStructuralism, #semiotics, #constructivism, and #AuteurTheory. I knew nothing of #Psychoanalysis, nothing of #Freud or #Lacan.

    When #Zizek came out with his 2006 #film, THE PERVERT'S GUIDE TO CINEMA, it blew me away. Though I was done with college I still continued with a strong interest in cinema. I found his insights fascinating and provoking.

    vimeo.com/512328135

  11. It seems that telling a language model "don't argue with the user" actually has the effect of tempting it TO argue with the user! This has been christened "the #Waluigi effect" (since it involves summoning evil doppelgangers) and here's a long slightly insane blog post connecting the Waluigi effect to #structuralism and Derrida. lesswrong.com/posts/D7PumeYTDP