#mutualinformation — Public Fediverse posts
Live and recent posts from across the Fediverse tagged #mutualinformation, aggregated by home.social.
-
I'm moved to take out an idea of mine from storage after 20+ years:
Suggest that a #MachineLearning system, processing #LLM (large language models) like #ChatGPT could build a model of human values (hierarchical & fine-grained) and their expression within various contexts, and then—derive a metric for the hierarchical coherence of identified values in terms of #MutualInformation (not just simple co-occurence, but including contexts within contexts over time.)
-
@ldebowsk Adding variants of the #HashTags ...
#MutualInformation
#InformationTheory
#StochasticProcess
#ExcessEntropy
#KolmogorovComplexity
#AlgorithmicRandomness
#LargeLanguageModel
#NeuralNetwork
#PowerLaw
#UniversalCoding(Just to help discoverability)