Artificial intelligence and large scale computation: A physics perspective

We study the macroscopic behavior of computation and examine both emergent collective phenomena and dynamical aspects with an emphasis on software issues, which are at the core of large scale distributed computation and artificial intelligence systems. By considering large systems, we exhibit novel phenomena which cannot be foreseen from examination of their smaller counterparts. We review both the symbolic and connectionist views of artificial intelligence, provide a number of examples which display these phenomena, and resort to statistical mechanics, dynamical systems theory and the theory of random graphs to elicit the range of possible behaviors.     

Analog-symbolic memory that tracks via reconsolidation

A fundamental part of a computational system is its memory, which is used to store and retrieve data. Classical computer memories rely on the static approach and are very different from human memories. Neural network memories are based on auto-associative attractor dynamics and thus provide a high level of pattern completion. However, they are not used in general computation since there are practically no algorithms to load an arbitrary landscape of attractors into them. In this sense neural network memory models cannot communicate well with symbolic and prior knowledge.We propose the design of a new memory based on localist attractor dynamics with reconsolidation called Reconsolidation Attractor Network (RAN). RAN combines symbolic and subsymbolic features in a very attractive way: it is based on attractors; enables pattern classification under missing data; and demonstrates dynamic reconsolidation, which is very useful for tracking changing concepts. The perception RAN enables is somewhat reminiscent of human perception due to its context sensitivity. Furthermore, it enables an immediate and clear interface with symbolic memories, including loading of attractors by means of trivial wiring, updating attractors, and retrieving them faster without waiting for full convergence. It also scales to any number of concepts. This provides a useful counterpoint to more conventional memory systems, such as random access memory and auto-associative neural networks.     

Toward physics of the mind: Concepts, emotions, consciousness, and symbols

Mathematical approaches to modeling the mind since the 1950s are reviewed, including artificial intelligence, pattern recognition, and neural networks. I analyze difficulties faced by these algorithms and neural networks and relate them to the fundamental inconsistency of logic discovered by Gödel. Mathematical discussions are related to those in neurobiology, psychology, cognitive science, and philosophy. Higher cognitive functions are reviewed including concepts, emotions, instincts, understanding, imagination, intuition, consciousness. Then, I describe a mathematical formulation, unifying the mind mechanisms in a psychologically and neuro-biologically plausible system. A mechanism of the knowledge instinct drives our understanding of the world and serves as a foundation for higher cognitive functions. This mechanism relates aesthetic emotions and perception of beauty to “everyday” functioning of the mind. The article reviews mechanisms of human symbolic ability. I touch on future directions: joint evolution of the mind, language, consciousness, and cultures; mechanisms of differentiation and synthesis; a manifold of aesthetic emotions in music and differentiated instinct for knowledge. I concentrate on elucidating the first principles; review aspects of the theory that have been proven in laboratory research, relationships between the mind and brain; discuss unsolved problems, and outline a number of theoretical predictions, which will have to be tested in future mathematical simulations and neuro-biological research.     

Physical models of cognition

This paper presents and discusses physical models for simulating some aspects of neural intelligence, and, in particular, the process of cognition. The main departure from the classical approach here is in utilization of a terminal version of classical dynamics introduced by the author earlier. Based upon violations of the Lipschitz condition at equilibrium points, terminal dynamics attains two new fundamental properties: it is spontaneous and nondeterministic. Special attention is focused on terminal neurodynamics as a particular architecture of terminal dynamics which is suitable for modeling of information flows. Terminal neurodynamics possesses a well-organized probabilistic structure which can be analytically predicted, prescribed, and controlled, and therefore which presents a powerful tool for modeling real-life uncertainties. Two basic phenomena associated with random behavior of neurodynamic solutions are exploited. The first one is a stochastic attractor—a stable stationary stochastic process to which random solutions of a closed system converge. As a model of the cognition process, a stochastic attractor can be viewed as a universal tool for generalization and formation of classes of patterns. The concept of stochastic attractor is applied to model a collective brain paradigm explaining coordination between simple units of intelligence which perform a collective task without direct exchange of information. The second fundamental phenomenon discussed is terminal chaos which occurs in open systems. Applications of terminal chaos to information fusion as well as to explanation and modeling of coordination among neurons in biological systems are discussed. It should be emphasized that all the models of terminal neurodynamics are implementable in analog devices, which means that all the cognition processes discussed in the paper are reducible to the laws of Newtonian mechanics.     

Biology,Buddhism, and AI: Care as the Driver of Intelligence

Intelligence is a central feature of human beings’ primary and interpersonal experience. Understanding how intelligence originated and scaled during evolution is a key challenge for modern biology. Some of the most important approaches to understanding intelligence are the ongoing efforts to build new intelligences in computer science (AI) and bioengineering. However, progress has been stymied by a lack of multidisciplinary consensus on what is central about intelligence regardless of the details of its material composition or origin (evolved vs. engineered). We show that Buddhist concepts offer a unique perspective and facilitate a consilience of biology, cognitive science, and computer science toward understanding intelligence in truly diverse embodiments. In coming decades, chimeric and bioengineering technologies will produce a wide variety of novel beings that look nothing like familiar natural life forms; how shall we gauge their moral responsibility and our own moral obligations toward them, without the familiar touchstones of standard evolved forms as comparison? Such decisions cannot be based on what the agent is made of or how much design vs. natural evolution was involved in their origin. We propose that the scope of our potential relationship with, and so also our moral duty toward, any being can be considered in the light of Care—a robust, practical, and dynamic lynchpin that formalizes the concepts of goal-directedness, stress, and the scaling of intelligence; it provides a rubric that, unlike other current concepts, is likely to not only survive but thrive in the coming advances of AI and bioengineering. We review relevant concepts in basal cognition and Buddhist thought, focusing on the size of an agent’s goal space (its cognitive light cone) as an invariant that tightly links intelligence and compassion. Implications range across interpersonal psychology, regenerative medicine, and machine learning. The Bodhisattva’s vow (“for the sake of all sentient life, I shall achieve awakening”) is a practical design principle for advancing intelligence in our novel creations and in ourselves.     

A compact program code for simulations of quantum algorithms in classical computers

A general quantum simulation language on a classical computer provides the opportunity to compare an experiential result from the development of quantum computers with mathematical theory. The intention of this research is to develop a program language that is able to make simulations of all quantum algorithms in same framework. This study examines the simulation of quantum algorithms on a classical computer with a symbolic programming language. We use the language Mathematica to make simulations of well-known quantum algorithms. The program code implemented on a classical computer will be a straight connection between the mathematical formulation of quantum mechanics and computational methods. This gives us an uncomplicated and clear language for the implementations of algorithms. The computational language includes essential formulations such as quantum state, superposition and quantum operator. This symbolic programming language provides a universal framework for examining the existing as well as future quantum algorithms. This study contributes with an implementation of a quantum algorithm in a program code where the substance is applicable in other simulations of quantum algorithms.     

Affect-Logic,Embodiment, Synergetics,and the Free Energy Principle: New Approaches to the Understanding and Treatment of Schizophrenia

This theoretical paper explores the affect-logic approach to schizophrenia in light of the general complexity theories of cognition: embodied cognition, Haken’s synergetics, and Friston’s free energy principle. According to affect-logic, the mental apparatus is an embodied system open to its environment, driven by bioenergetic inputs of emotions. Emotions are rooted in goal-directed embodied states selected by evolutionary pressure for coping with specific situations such as fight, flight, attachment, and others. According to synergetics, nonlinear bifurcations and the emergence of new global patterns occur in open systems when control parameters reach a critical level. Applied to the emergence of psychotic states, synergetics and the proposed energetic understanding of emotions lead to the hypothesis that critical levels of emotional tension may be responsible for the transition from normal to psychotic modes of functioning in vulnerable individuals. In addition, the free energy principle through learning suggests that psychotic symptoms correspond to alternative modes of minimizing free energy, which then entails distorted perceptions of the body, self, and reality. This synthetic formulation has implications for novel therapeutic and preventive strategies in the treatment of psychoses, among these are milieu-therapeutic approaches of the Soteria type that focus on a sustained reduction of emotional tension and phenomenologically oriented methods for improving the perception of body, self, and reality.     

Hierarchical Classification of Event-Related Potentials for the Recognition of Gender Differences in the Attention Task

Research on the functioning of human cognition has been a crucial problem studied for years. Electroencephalography (EEG) classification methods may serve as a precious tool for understanding the temporal dynamics of human brain activity, and the purpose of such an approach is to increase the statistical power of the differences between conditions that are too weak to be detected using standard EEG methods. Following that line of research, in this paper, we focus on recognizing gender differences in the functioning of the human brain in the attention task. For that purpose, we gathered, analyzed, and finally classified event-related potentials (ERPs). We propose a hierarchical approach, in which the electrophysiological signal preprocessing is combined with the classification method, enriched with a segmentation step, which creates a full line of electrophysiological signal classification during an attention task. This approach allowed us to detect differences between men and women in the P3 waveform, an ERP component related to attention, which were not observed using standard ERP analysis. The results provide evidence for the high effectiveness of the proposed method, which outperformed a traditional statistical analysis approach. This is a step towards understanding neuronal differences between men’s and women’s brains during cognition, aiming to reduce the misdiagnosis and adverse side effects in underrepresented women groups in health and biomedical research.     

Information Field Theory and Artificial Intelligence

Information field theory (IFT), the information theory for fields, is a mathematical framework for signal reconstruction and non-parametric inverse problems. Artificial intelligence (AI) and machine learning (ML) aim at generating intelligent systems, including such for perception, cognition, and learning. This overlaps with IFT, which is designed to address perception, reasoning, and inference tasks. Here, the relation between concepts and tools in IFT and those in AI and ML research are discussed. In the context of IFT, fields denote physical quantities that change continuously as a function of space (and time) and information theory refers to Bayesian probabilistic logic equipped with the associated entropic information measures. Reconstructing a signal with IFT is a computational problem similar to training a generative neural network (GNN) in ML. In this paper, the process of inference in IFT is reformulated in terms of GNN training. In contrast to classical neural networks, IFT based GNNs can operate without pre-training thanks to incorporating expert knowledge into their architecture. Furthermore, the cross-fertilization of variational inference methods used in IFT and ML are discussed. These discussions suggest that IFT is well suited to address many problems in AI and ML research and application.     

Complete description of the interactions of a quadrupolar nucleus with a radiofrequency field. Implications for data fitting

We present a theory, with experimental tests, that treats exactly the effect of radiofrequency (RF) fields on quadrupolar nuclei, yet retains the symbolic expressions as much as possible. This provides a mathematical model of these interactions that can be easily connected to state-of-the-art optimization methods, so that chemically-important parameters can be extracted from fits to experimental data. Nuclei with spins >1/2 typically experience a Zeeman interaction with the (possibly anisotropic) local static field, a quadrupole interaction and are manipulated with RF fields. Since RF fields are limited by hardware, they seldom dominate the other interactions of these nuclei and so the spectra show unusual dependence on the pulse width used. The theory is tested with ²³Na NMR nutation spectra of a single crystal of sodium nitrate, in which the RF is comparable with the quadrupole coupling and is not necessarily on resonance with any of the transitions. Both the intensity and phase of all three transitions are followed as a function of flip angle. This provides a more rigorous trial than a powder sample where many of the details are averaged out. The formalism is based on a symbolic approach which encompasses all the published results, yet is easily implemented numerically, since no explicit spin operators or their commutators are needed. The classic perturbation results are also easily derived. There are no restrictions or assumptions on the spin of the nucleus or the relative sizes of the interactions, so the results are completely general, going beyond the standard first-order treatments in the literature.     

Statistics of self-crossings and avoided crossings of periodic orbits in the Hadamard-Gutzwiller model

Employing symbolic dynamics for geodesic motion on the tesselated pseudosphere, the so-called Hadamard-Gutzwiller model, we construct extremely long periodic orbits without compromising accuracy. We establish criteria for such long orbits to behave ergodically and to yield reliable statistics for self-crossings and avoided crossings. Self-encounters of periodic orbits are reflected in certain patterns within symbol sequences, and these allow for analytic treatment of the crossing statistics. In particular, the distributions of crossing angles and avoided-crossing widths thus come out as related by analytic continuation. Moreover, the action difference for Sieber-Richter pairs of orbits (one orbit has a self-crossing which the other narrowly avoids and otherwise the orbits look very nearly the same) results to all orders in the crossing angle. These findings may be helpful for extending the work of Sieber and Richter towards a fuller understanding of the classical basis of quantum spectral fluctuations. Received 17 July 2002 Published online 29 November 2002     

Symbolic dynamics of one-dimensional maps: Entropies,finite precision,and noise

In the study of nonlinear physical systems, one encounters apparently random or chaotic behavior, although the systems may be completely deterministic. Applying techniques from symbolic dynamics to maps of the interval, we compute two measures of chaotic behavior commonly employed in dynamical systems theory: the topological and metric entropies. For the quadratic logistic equation, we find that the metric entropy converges very slowly in comparison to maps which are strictly hyperbolic. The effects of finite precision arithmetric and external noise on chaotic behavior are characterized with the symbolic dynamics entropies. Finally, we discuss the relationship of these measures of chaos to algorithmic complexity, and use algorithmic information theory as a framework to discuss the construction of models for chaotic dynamics.     

Topological invariants in the study of a chaotic food chain system

The study of ecological systems has generated deep interest in exploring the complexity of chaotic food chains. The role of chaos in ecosystems is not entirely understood. One approach to have a better comprehension of ecological chaos is by analyzing it in mathematical models of basic food chains. In this article it is considered a classical chaotic food chain model from the literature. We use the theory of symbolic dynamics to study the topological entropy and the parameter space ordering of kneading sequences associated with one-dimensional maps that reproduce significant aspects of the model dynamics. The topological entropy allows us to distinguish different chaotic states in some realistic system parameter region. Another numerical invariant is introduced in order to characterize isentropic dynamics. Studying a set of maps with the same topological entropy, we exhibit numerical results about the relation between the second topological invariant and each of the control parameters in consideration. This work provides an illustration of how our understanding of ecological models can be enhanced by the theory of symbolic dynamics.     

Corticonic models of brain mechanisms underlying cognition and intelligence

The concern of this review is brain theory or more specifically, in its first part, a model of the cerebral cortex and the way it: (a) interacts with subcortical regions like the thalamus and the hippocampus to provide higher-level-brain functions that underlie cognition and intelligence, (b) handles and represents dynamical sensory patterns imposed by a constantly changing environment, (c) copes with the enormous number of such patterns encountered in a lifetime by means of dynamic memory that offers an immense number of stimulus-specific attractors for input patterns (stimuli) to select from, (d) selects an attractor through a process of “conjugation” of the input pattern with the dynamics of the thalamo–cortical loop, (e) distinguishes between redundant (structured) and non-redundant (random) inputs that are void of information, (f) can do categorical perception when there is access to vast associative memory laid out in the association cortex with the help of the hippocampus, and (g) makes use of “computation” at the edge of chaos and information driven annealing to achieve all this. Other features and implications of the concepts presented for the design of computational algorithms and machines with brain-like intelligence are also discussed. The material and results presented suggest, that a Parametrically Coupled Logistic Map network (PCLMN) is a minimal model of the thalamo–cortical complex and that marrying such a network to a suitable associative memory with re-entry or feedback forms a useful, albeit, abstract model of a cortical module of the brain that could facilitate building a simple artificial brain.

In the second part of the review, the results of numerical simulations and drawn conclusions in the first part are linked to the most directly relevant works and views of other workers. What emerges is a picture of brain dynamics on the mesoscopic and macroscopic scales that gives a glimpse of the nature of the long sought after brain code underlying intelligence and other higher level brain functions.     

Periodic orbits in a two-variable coupled map

Periodic orbits are calculated for a linear transformation composed of two coupled tent maps using a symbolic dynamics defined as the direct product of the single-map symbols {0,1,2}. As the coupling strength is increased orbits are pruned and a crossover to one-dimensional behavior is observed. The disallowed binary orbits containing only symbols {0,1} form a connected region in a binary symbol plane. Stable orbits may appear for strong couplings.     

Recent progress in econophysics: Chaos,leverage, and business cycles as revealed by agent-based modeling and human experiments

Agent-based modeling and controlled human experiments serve as two fundamental research methods in the field of econophysics. Agent-based modeling has been in development for over 20 years, but how to design virtual agents with high levels of human-like “intelligence” remains a challenge. On the other hand, experimental econophysics is an emerging field; however, there is a lack of experience and paradigms related to the field. Here, we review some of the most recent research results obtained through the use of these two methods concerning financial problems such as chaos, leverage, and business cycles. We also review the principles behind assessments of agents’ intelligence levels, and some relevant designs for human experiments. The main theme of this review is to show that by combining theory, agent-based modeling, and controlled human experiments, one can garner more reliable and credible results on account of a better verification of theory; accordingly, this way, a wider range of economic and financial problems and phenomena can be studied.     

Swarmtrust: A swarm optimization-based approach to enhance trustworthiness in smart homes

As smart home networks become increasingly complex and dynamic, maintaining trust between the various devices and services is crucial. Existing trust management approaches face challenges such as high computational overhead and difficulty in selecting optimal parameters. To address these challenges, we propose a new method for trust management in smart home networks based on swarm optimization, a principle of swarm intelligence. Our proposed approach is based on swarm optimization, which is a principle of swarm intelligence that optimizes communication patterns and manages trust values within the network. In SwarmTrust, the nodes in the smart home network are represented by particles, and the positions and velocities of these particles are adjusted to optimize communication patterns and reduce the computational burden on nodes. This optimization is achieved by evaluating the trust values of each node and adjusting the communication patterns accordingly. The proposed method integrates trust management with several distinct parameters and selects the parameters optimally to maintain efficiency. The proposed approach also addresses optimization challenges by monitoring communication patterns and managing trust values in a distributed manner, which reduces the computational burden on nodes and maintains efficiency. To evaluate the effectiveness of our proposed approach, we conducted simulation experiments and compared the performance of our approach with existing methods. Our results showed notable improvements in terms of computational efficiency and optimized computation.     

Symbolic Dynamics for the Sin Map

By investigating the sin map, the symbolic dynamics on the two-dimensional map was generalized. We constructed the infinite-word symbolic dynamics, and reduced it to the definiteword symbolic dynamics composed of a suitable number of the words. In the examples of the symbol analysis, all the permitted periodic objects up to period four were identified, and some chaotic trajectors were derived.     

Dynamics analysis on neural firing patterns by symbolic approach

Neural firing patterns are investigated by using symbolic dynamics. Bifurcation behaviour of the Hindmarsh--Rose (HR) neuronal model is simulated with the external stimuli gradually decreasing, and various firing activities with different topological structures are orderly numbered. Through constructing first-return maps of interspike intervals, all firing patterns are described and identified by symbolic expressions. On the basis of ordering rules of symbolic sequences, the corresponding relation between parameters and firing patterns is established, which will be helpful for encoding neural information. Moreover, using the operation rule of $\ast$ product, generation mechanisms and intrinsic configurations of periodic patterns can be distinguished in detail. Results show that the symbolic approach is a powerful tool to study neural firing activities. In particular, such a coarse-grained way can be generalized in neural electrophysiological experiments to extract much valuable information from complicated experimental data.     

Grounding language in action and perception: From cognitive agents to humanoid robots

In this review we concentrate on a grounded approach to the modeling of cognition through the methodologies of cognitive agents and developmental robotics. This work will focus on the modeling of the evolutionary and developmental acquisition of linguistic capabilities based on the principles of symbol grounding. We review cognitive agent and developmental robotics models of the grounding of language to demonstrate their consistency with the empirical and theoretical evidence on language grounding and embodiment, and to reveal the benefits of such an approach in the design of linguistic capabilities in cognitive robotic agents. In particular, three different models will be discussed, where the complexity of the agent's sensorimotor and cognitive system gradually increases: from a multi-agent simulation of language evolution, to a simulated robotic agent model for symbol grounding transfer, to a model of language comprehension in the humanoid robot iCub. The review also discusses the benefits of the use of humanoid robotic platform, and specifically of the open source iCub platform, for the study of embodied cognition.