The Representational Relation Between Environmental Structures and Neural Systems: Autonomy and Environmental Dependency in Neural Knowledge Representation

In this paper it will be shown that in neural systems with a recurrent architecture, the traditional concepts of knowledge representation cannot be applied any more; no stable representational relationship of reference can be found. That is why a redefinition of the relationship between the states of the environment and the internal representational states is proposed. Studying the dynamics of recurrent neural systems reveals that the goal of representation is no longer to map the environment as accurately as possible to the representation system (e.g., to symbols). It is suggested that it is more appropriate to look at neural systems as physical dynamical devices embodying the (transformation) knowledge for sensorimotor integration and for generating adequate behavior enabling the organism's survival. As an implication the representation is determined not only by the environment, but highly depends on the organization, structure, and constraints of the representation system as well as the sensory/motor systems which are embedded in a particular body structure. This leads to a system relative concept of representation. By transforming recurrent neural networks into the domain of finite automata, the dynamics as well as the epistemological implications become more clear. In recurrent neural systems a type of balance between the autonomy of the representation and the environmental dependence/influence emerges. This not only affects the traditional concept of knowledge representation, but has also implications for the understanding of semantics, language, communication, and even science.