#cognitiverobotics — Public Fediverse posts

A lot of #MachineLearning and #PredictiveModelling in #statistics is based on minimisation of loss with respect to a training data set. This assumes that the training data set as a whole is representative of potential training sets. Consequently, this implies that loss minimisation is not an appropriate approach (or way of conceptualising the problem) in problems where the training data sets are not representative of the potential testing sets. (As a working title, let's call this issue "radical nonstationarity".)

I recently read Javed & Sutton 2024 "The Big World Hypothesis and its Ramifications for Artificial Intelligence" (https://web.archive.org/web/20250203053026/https://openreview.net/forum?id=Sv7DazuCn8) and think it describes a superset of this issue of radical nonstationarity. I strongly recommend this paper for motivating why loss minimisation with respect to a training data set might not always be appropriate.

Imagine an intelligent agent existing over time in a "big world" environment. Each observation records information about a single interaction of the agent with it's environment, and this observation only records the locally observable part of the environment. The agent may be moving between locations in the environment that are radically different with respect to the predictive relationships that exist and the variables that are predictive of the outcome of interest may vary between observations. Nonetheless, there is some predictive information that an intelligent agent could exploit. The case where everything is totally random and unpredictable is of no interest when the focus of research is an intelligent agent. In such a world minimising loss with respect to the history of all observations seen by the agent or even a sliding window of recent history seems irrelevant to the point of obtuseness.

One possible approach to this issue might be for the agent to determine, on a per-observation basis, the subset of past observations that are most relevant to making a prediction for the current observation. Then loss minimisation might play some role in determining or using that subset. However, that use of a dynamically determined training set is not the same thing as loss minimisation with respect to a statically given training set.

I am trying to find pointers to scholarly literature that discusses this issue (i.e. situations where minimisation of loss with respect to some "fixed" training set). My problem is that I am struggling to come up with search terms to find them. So:

* Please suggest search terms that might help me find this literature
* Please provide pointers to relevant papers

#PhilosophyOfStatistics #PhilosophyOfMachineLearning #CognitiveRobotics #MathematicalPsychology #MathPsych #CognitiveScience #CogSci #CognitiveNeuroscience #nonstationarity #LossMinimisation

@cogsci
The notion of role-filler binding as central to cognitive(ish) representations has been around for ages (possibly under different names, such as slot-value in GOFAI: https://en.wikipedia.org/wiki/Frame_(artificial_intelligence)). This is hardly surprising because it's effectively the same as variable-value.

The role is generally treated as though it's an atomic symbol, whereas it's not uncommon for the filler to be taken as a composite value (e.g. a tree). I am toying with embracing the idea of roles also being composite representations.

In a cognitive-agent/robotic context, I think it might be useful for the role to be a "sensorimotor program" and the filler to be the sensory input arising from running the sensorimotor program specified by the role. (This is heading towards a Predictive State Representation: https://en.wikipedia.org/wiki/Predictive_state_representation).

(1) I would greatly appreciate any pointers to discussions of role-filler bindings as sensorimotor predictions (similar or related to the sense above).

"Attention" could be construed as a "run/don't_run" flag in the sensorimotor program. This is basically treating attention as a kind of action and "don't attend" as not doing that action. (If that were true it's possible that there may also be other attention mechanisms, e.g. the precision weighting posited by Predictive Coding: https://en.wikipedia.org/wiki/Predictive_coding#Precision_weighting).

(2) I would greatly appreciate any pointers to discussions of attention as a kind of executable sensorimotor action.

#CogSci #CognitiveScience #CognitiveRobotics #CognitiveNeuroscience #neuroscience

Lulea Technical University (Sweden) announces two open positions ultimately focusing on research on hyperdimensional computing and vector-symbolic architectures. The positions are connected to the recently approved grant by Swedish Research Council "Vector-symbolic architectures as an algebraic programming language for neuromorphic computers”.

The application deadline is January 31st, 2023

Position 1. Senior lecturer: https://lnkd.in/gu5zf69T

Position 2. Researcher: https://lnkd.in/giSuqkFi

Should you have any questions please write to Evgeny Osipov ([email protected]).

#VSA #VectorSymbolicArchitecture #HDC #HyperdimensionalComputing #CogSci #CognitiveScience #CogRob #CognitiveRobotics #MathPsych #CompCogSci #CompSci #ComputerScience #neuromorphic
#job