#compositionality — Public Fediverse posts

2018年の科学基礎論学会発表における『そもそも意味の合成性は必要なのか？』

https://phsc.jp/dat/rsm/201805

#論文メモ #compositionality

「king - man + woman = queen」は Fodor のいう合成性に適っているのかな。Fodor and Lepore (1991) の黄色い牛の例を見ると、言えそうなんだよな。つまり合成性の原理は Mikolov の単語ベクトルまでは若干保たれていると言えて、Transformer 以後は言えないということなのかもしれない。計算言語学はこの性質を加法構成性と呼んでいるのも興味深い。

#compositionality

また、合成性の原理における「意味」を「分散表現」とした分散表現的な合成性原理 (Lenci and Sahlgren 2023: 346) についても、一般的に言語モデルには適合しないと思われる。なぜならば、言語モデルにおける「統語節 (syntactic node)」がなにかが明らかではない。

#philosophy_of_LLM #compositionality

Another interesting paper on #compositionality and #transformers: https://arxiv.org/abs/2403.11834 #nlproc

I have a number of posts on my blog about the topic: http://dstrohmaier.com/compositionality-word-meaning/ http://dstrohmaier.com/compositionality-a-paper/ http://dstrohmaier.com/transformer-speculations/

Another interesting paper on #compositionality and #transformers: https://arxiv.org/abs/2403.11834 #nlproc

I have a number of posts on my blog about the topic: http://dstrohmaier.com/compositionality-word-meaning/ http://dstrohmaier.com/compositionality-a-paper/ http://dstrohmaier.com/transformer-speculations/

Inquiry Into Inquiry • Discussion 9
• http://inquiryintoinquiry.com/2023/08/19/inquiry-into-inquiry-discussion-9/

Re: Milo Gardner
• https://www.academia.edu/community/VBqzR5?c=Q4jJVy

MG: ❝Do you agree that Peirce was limited to bivalent logic?❞

Taking classical logic as a basis for reasoning is no more limiting than taking Dedekind cuts as a basis for constructing the real number line. For Peirce's relational approach to logic as semiotics the number of dimensions in a relation is more important than the number of values in each dimension. That is where 3 makes a difference over 2.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 9
• http://inquiryintoinquiry.com/2023/08/19/inquiry-into-inquiry-discussion-9/

Re: Milo Gardner
• https://www.academia.edu/community/VBqzR5?c=Q4jJVy

MG: ❝Do you agree that Peirce was limited to bivalent logic?❞

Taking classical logic as a basis for reasoning is no more limiting than taking Dedekind cuts as a basis for constructing the real number line. For Peirce's relational approach to logic as semiotics the number of dimensions in a relation is more important than the number of values in each dimension. That is where 3 makes a difference over 2.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 9
• http://inquiryintoinquiry.com/2023/08/19/inquiry-into-inquiry-discussion-9/

Re: Milo Gardner
• https://www.academia.edu/community/VBqzR5?c=Q4jJVy

MG: ❝Do you agree that Peirce was limited to bivalent logic?❞

Taking classical logic as a basis for reasoning is no more limiting than taking Dedekind cuts as a basis for constructing the real number line. For Peirce's relational approach to logic as semiotics the number of dimensions in a relation is more important than the number of values in each dimension. That is where 3 makes a difference over 2.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 9
• http://inquiryintoinquiry.com/2023/08/19/inquiry-into-inquiry-discussion-9/

Re: Milo Gardner
• https://www.academia.edu/community/VBqzR5?c=Q4jJVy

MG: ❝Do you agree that Peirce was limited to bivalent logic?❞

Taking classical logic as a basis for reasoning is no more limiting than taking Dedekind cuts as a basis for constructing the real number line. For Peirce's relational approach to logic as semiotics the number of dimensions in a relation is more important than the number of values in each dimension. That is where 3 makes a difference over 2.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 9
• http://inquiryintoinquiry.com/2023/08/19/inquiry-into-inquiry-discussion-9/

Re: Milo Gardner
• https://www.academia.edu/community/VBqzR5?c=Q4jJVy

MG: ❝Do you agree that Peirce was limited to bivalent logic?❞

Taking classical logic as a basis for reasoning is no more limiting than taking Dedekind cuts as a basis for constructing the real number line. For Peirce's relational approach to logic as semiotics the number of dimensions in a relation is more important than the number of values in each dimension. That is where 3 makes a difference over 2.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 8
• http://inquiryintoinquiry.com/2023/08/18/inquiry-into-inquiry-discussion-8/

Re: Milo Gardner
• https://www.academia.edu/community/Lbxjg5?c=yqXVog

MG:
❝Peirce sensed that bivalent syntax was superceded by trivalent syntax, but never resolved that nagging question.❞

My Comment —

The main thing is not a question of syntax but a question of the mathematical models we use to cope with object realities and real objectives (“pragmata”). Signs, syntax, and systems of representation can make a big difference in how well they represent the object domain and how well they serve the purpose at hand but they remain accessory to those objects and purposes.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 8
• http://inquiryintoinquiry.com/2023/08/18/inquiry-into-inquiry-discussion-8/

Re: Milo Gardner
• https://www.academia.edu/community/Lbxjg5?c=yqXVog

MG:
❝Peirce sensed that bivalent syntax was superceded by trivalent syntax, but never resolved that nagging question.❞

My Comment —

The main thing is not a question of syntax but a question of the mathematical models we use to cope with object realities and real objectives (“pragmata”). Signs, syntax, and systems of representation can make a big difference in how well they represent the object domain and how well they serve the purpose at hand but they remain accessory to those objects and purposes.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 8
• http://inquiryintoinquiry.com/2023/08/18/inquiry-into-inquiry-discussion-8/

Re: Milo Gardner
• https://www.academia.edu/community/Lbxjg5?c=yqXVog

MG:
❝Peirce sensed that bivalent syntax was superceded by trivalent syntax, but never resolved that nagging question.❞

My Comment —

The main thing is not a question of syntax but a question of the mathematical models we use to cope with object realities and real objectives (“pragmata”). Signs, syntax, and systems of representation can make a big difference in how well they represent the object domain and how well they serve the purpose at hand but they remain accessory to those objects and purposes.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 8
• http://inquiryintoinquiry.com/2023/08/18/inquiry-into-inquiry-discussion-8/

Re: Milo Gardner
• https://www.academia.edu/community/Lbxjg5?c=yqXVog

MG:
❝Peirce sensed that bivalent syntax was superceded by trivalent syntax, but never resolved that nagging question.❞

My Comment —

The main thing is not a question of syntax but a question of the mathematical models we use to cope with object realities and real objectives (“pragmata”). Signs, syntax, and systems of representation can make a big difference in how well they represent the object domain and how well they serve the purpose at hand but they remain accessory to those objects and purposes.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 8
• http://inquiryintoinquiry.com/2023/08/18/inquiry-into-inquiry-discussion-8/

Re: Milo Gardner
• https://www.academia.edu/community/Lbxjg5?c=yqXVog

MG:
❝Peirce sensed that bivalent syntax was superceded by trivalent syntax, but never resolved that nagging question.❞

My Comment —

The main thing is not a question of syntax but a question of the mathematical models we use to cope with object realities and real objectives (“pragmata”). Signs, syntax, and systems of representation can make a big difference in how well they represent the object domain and how well they serve the purpose at hand but they remain accessory to those objects and purposes.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 7
• http://inquiryintoinquiry.com/2023/08/17/inquiry-into-inquiry-discussion-7/

Dan Everett has prompted a number of discussions on Facebook recently which touch on core issues in Peirce's thought — but threads ravel on and fray so quickly in that medium one rarely gets a chance to fill out the warp. Not exactly at random, here's a loose thread I think may be worth the candle.

Re: Facebook • Daniel Everett
• https://www.facebook.com/permalink.php?story_fbid=pfbid0be89MXhhCm8rxahRn4PXif6HHSCmkdiUFfMZ3qS1mNqSzRzUWfqej5a8cyz8TcyJl&id=100093271525294

My Comment —

Compositionality started out as a well-defined concept, arising from the composition of mathematical functions, abstracted to the composition of arrows and functors in category theory, and generalized to the composition of binary, two-place, or dyadic relations. In terms of linguistic complexity it's associated with properly context-free languages. That all keeps compositionality on the dyadic side of the border in Peirce's universe. More lately the term has been volatilized to encompass almost any sort of information fusion, which is all well and good so long as folks make it clear what they are talking about, for which use the term “information fusion” would probably be sufficiently vague.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 7
• http://inquiryintoinquiry.com/2023/08/17/inquiry-into-inquiry-discussion-7/

Dan Everett has prompted a number of discussions on Facebook recently which touch on core issues in Peirce's thought — but threads ravel on and fray so quickly in that medium one rarely gets a chance to fill out the warp. Not exactly at random, here's a loose thread I think may be worth the candle.

Re: Facebook • Daniel Everett
• https://www.facebook.com/permalink.php?story_fbid=pfbid0be89MXhhCm8rxahRn4PXif6HHSCmkdiUFfMZ3qS1mNqSzRzUWfqej5a8cyz8TcyJl&id=100093271525294

My Comment —

Compositionality started out as a well-defined concept, arising from the composition of mathematical functions, abstracted to the composition of arrows and functors in category theory, and generalized to the composition of binary, two-place, or dyadic relations. In terms of linguistic complexity it's associated with properly context-free languages. That all keeps compositionality on the dyadic side of the border in Peirce's universe. More lately the term has been volatilized to encompass almost any sort of information fusion, which is all well and good so long as folks make it clear what they are talking about, for which use the term “information fusion” would probably be sufficiently vague.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 7
• http://inquiryintoinquiry.com/2023/08/17/inquiry-into-inquiry-discussion-7/

Dan Everett has prompted a number of discussions on Facebook recently which touch on core issues in Peirce's thought — but threads ravel on and fray so quickly in that medium one rarely gets a chance to fill out the warp. Not exactly at random, here's a loose thread I think may be worth the candle.

Re: Facebook • Daniel Everett
• https://www.facebook.com/permalink.php?story_fbid=pfbid0be89MXhhCm8rxahRn4PXif6HHSCmkdiUFfMZ3qS1mNqSzRzUWfqej5a8cyz8TcyJl&id=100093271525294

My Comment —

Compositionality started out as a well-defined concept, arising from the composition of mathematical functions, abstracted to the composition of arrows and functors in category theory, and generalized to the composition of binary, two-place, or dyadic relations. In terms of linguistic complexity it's associated with properly context-free languages. That all keeps compositionality on the dyadic side of the border in Peirce's universe. More lately the term has been volatilized to encompass almost any sort of information fusion, which is all well and good so long as folks make it clear what they are talking about, for which use the term “information fusion” would probably be sufficiently vague.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 7
• http://inquiryintoinquiry.com/2023/08/17/inquiry-into-inquiry-discussion-7/

Dan Everett has prompted a number of discussions on Facebook recently which touch on core issues in Peirce's thought — but threads ravel on and fray so quickly in that medium one rarely gets a chance to fill out the warp. Not exactly at random, here's a loose thread I think may be worth the candle.

Re: Facebook • Daniel Everett
• https://www.facebook.com/permalink.php?story_fbid=pfbid0be89MXhhCm8rxahRn4PXif6HHSCmkdiUFfMZ3qS1mNqSzRzUWfqej5a8cyz8TcyJl&id=100093271525294

My Comment —

Compositionality started out as a well-defined concept, arising from the composition of mathematical functions, abstracted to the composition of arrows and functors in category theory, and generalized to the composition of binary, two-place, or dyadic relations. In terms of linguistic complexity it's associated with properly context-free languages. That all keeps compositionality on the dyadic side of the border in Peirce's universe. More lately the term has been volatilized to encompass almost any sort of information fusion, which is all well and good so long as folks make it clear what they are talking about, for which use the term “information fusion” would probably be sufficiently vague.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Inquiry Into Inquiry • Discussion 7
• http://inquiryintoinquiry.com/2023/08/17/inquiry-into-inquiry-discussion-7/

Dan Everett has prompted a number of discussions on Facebook recently which touch on core issues in Peirce's thought — but threads ravel on and fray so quickly in that medium one rarely gets a chance to fill out the warp. Not exactly at random, here's a loose thread I think may be worth the candle.

Re: Facebook • Daniel Everett
• https://www.facebook.com/permalink.php?story_fbid=pfbid0be89MXhhCm8rxahRn4PXif6HHSCmkdiUFfMZ3qS1mNqSzRzUWfqej5a8cyz8TcyJl&id=100093271525294

My Comment —

Compositionality started out as a well-defined concept, arising from the composition of mathematical functions, abstracted to the composition of arrows and functors in category theory, and generalized to the composition of binary, two-place, or dyadic relations. In terms of linguistic complexity it's associated with properly context-free languages. That all keeps compositionality on the dyadic side of the border in Peirce's universe. More lately the term has been volatilized to encompass almost any sort of information fusion, which is all well and good so long as folks make it clear what they are talking about, for which use the term “information fusion” would probably be sufficiently vague.

#Peirce #Logic #Inquiry #Inference #Information #InformationFusion #Semiotics
#CategoryTheory #Compositionality #RelationTheory #TriadicRelationIrreducibility

Cool new work linking #cognitive science and #AI

Investigating #Compositional and #Semantic #Understanding in Video Retrieval #Models

by Avinash Madasu and Vasudev Lal

https://arxiv.org/abs/2306.16533

@cogsci #NeuroAI #CognitiveAI #ML #compositionality #cogsci #cog

Cool new work linking #cognitive science and #AI

Investigating #Compositional and #Semantic #Understanding in Video Retrieval #Models

by Avinash Madasu and Vasudev Lal

https://arxiv.org/abs/2306.16533

@cogsci #NeuroAI #CognitiveAI #ML #compositionality #cogsci #cog

Cool new work linking #cognitive science and #AI

Investigating #Compositional and #Semantic #Understanding in Video Retrieval #Models

by Avinash Madasu and Vasudev Lal

https://arxiv.org/abs/2306.16533

@cogsci #NeuroAI #CognitiveAI #ML #compositionality #cogsci #cog

Cool new work linking #cognitive science and #AI

Investigating #Compositional and #Semantic #Understanding in Video Retrieval #Models

by Avinash Madasu and Vasudev Lal

https://arxiv.org/abs/2306.16533

@cogsci #NeuroAI #CognitiveAI #ML #compositionality #cogsci #cog

Cool new work linking #cognitive science and #AI

Investigating #Compositional and #Semantic #Understanding in Video Retrieval #Models

by Avinash Madasu and Vasudev Lal

https://arxiv.org/abs/2306.16533

@cogsci #NeuroAI #CognitiveAI #ML #compositionality #cogsci #cog

another day, another surprise non-compositional behaviour with unix `fork` (this time, signal handlers...)

#fork #compositionality #linux

another day, another surprise non-compositional behaviour with unix `fork` (this time, signal handlers...)

#fork #compositionality #linux

another day, another surprise non-compositional behaviour with unix `fork` (this time, signal handlers...)

#fork #compositionality #linux

another day, another surprise non-compositional behaviour with unix `fork` (this time, signal handlers...)

#fork #compositionality #linux

another day, another surprise non-compositional behaviour with unix `fork` (this time, signal handlers...)

#fork #compositionality #linux

making roast pre-Christmas dinner, so of course there's a Gantt chart, and some vague wondering about writing some monoidal-category based software to sort this all out for me

#gantt #goose #dinner #compositionality

making roast pre-Christmas dinner, so of course there's a Gantt chart, and some vague wondering about writing some monoidal-category based software to sort this all out for me

#gantt #goose #dinner #compositionality

making roast pre-Christmas dinner, so of course there's a Gantt chart, and some vague wondering about writing some monoidal-category based software to sort this all out for me

#gantt #goose #dinner #compositionality

making roast pre-Christmas dinner, so of course there's a Gantt chart, and some vague wondering about writing some monoidal-category based software to sort this all out for me

#gantt #goose #dinner #compositionality

making roast pre-Christmas dinner, so of course there's a Gantt chart, and some vague wondering about writing some monoidal-category based software to sort this all out for me

#gantt #goose #dinner #compositionality

Follow up #introduction since I didn’t include actual searchable tags! In real life I like jokes and roller derby but here I mainly talk about #nlproc #nlp #scienceofdl #trainingdynamics #deeplearning #losslandscapes #compositionality #generalization

Follow up #introduction since I didn’t include actual searchable tags! In real life I like jokes and roller derby but here I mainly talk about #nlproc #nlp #scienceofdl #trainingdynamics #deeplearning #losslandscapes #compositionality #generalization

Follow up #introduction since I didn’t include actual searchable tags! In real life I like jokes and roller derby but here I mainly talk about #nlproc #nlp #scienceofdl #trainingdynamics #deeplearning #losslandscapes #compositionality #generalization

Follow up #introduction since I didn’t include actual searchable tags! In real life I like jokes and roller derby but here I mainly talk about #nlproc #nlp #scienceofdl #trainingdynamics #deeplearning #losslandscapes #compositionality #generalization

Follow up #introduction since I didn’t include actual searchable tags! In real life I like jokes and roller derby but here I mainly talk about #nlproc #nlp #scienceofdl #trainingdynamics #deeplearning #losslandscapes #compositionality #generalization

This came out last month but I thought I'd take the opportunity to boost it here.
Stefan Hartmann, Ryan Lepic and I published a paper on Compositionality in Different Modalities: A View from Usage-Based Linguistics in the International Journal of Primatology
https://link.springer.com/article/10.1007/s10764-022-00330-x
We discuss concepts of #compositionality in spoken and signed languages and what their implications are for #LanguageEvolution and analyses of compositionality in #AnimalCommunication #OpenAccess

This came out last month but I thought I'd take the opportunity to boost it here.
Stefan Hartmann, Ryan Lepic and I published a paper on Compositionality in Different Modalities: A View from Usage-Based Linguistics in the International Journal of Primatology
https://link.springer.com/article/10.1007/s10764-022-00330-x
We discuss concepts of #compositionality in spoken and signed languages and what their implications are for #LanguageEvolution and analyses of compositionality in #AnimalCommunication #OpenAccess

This came out last month but I thought I'd take the opportunity to boost it here.
Stefan Hartmann, Ryan Lepic and I published a paper on Compositionality in Different Modalities: A View from Usage-Based Linguistics in the International Journal of Primatology
https://link.springer.com/article/10.1007/s10764-022-00330-x
We discuss concepts of #compositionality in spoken and signed languages and what their implications are for #LanguageEvolution and analyses of compositionality in #AnimalCommunication #OpenAccess

This came out last month but I thought I'd take the opportunity to boost it here.
Stefan Hartmann, Ryan Lepic and I published a paper on Compositionality in Different Modalities: A View from Usage-Based Linguistics in the International Journal of Primatology
https://link.springer.com/article/10.1007/s10764-022-00330-x
We discuss concepts of #compositionality in spoken and signed languages and what their implications are for #LanguageEvolution and analyses of compositionality in #AnimalCommunication #OpenAccess

This came out last month but I thought I'd take the opportunity to boost it here.
Stefan Hartmann, Ryan Lepic and I published a paper on Compositionality in Different Modalities: A View from Usage-Based Linguistics in the International Journal of Primatology
https://link.springer.com/article/10.1007/s10764-022-00330-x
We discuss concepts of #compositionality in spoken and signed languages and what their implications are for #LanguageEvolution and analyses of compositionality in #AnimalCommunication #OpenAccess