Tag: #TheInformationLens
-
The Universal Optimism of the Self-Evidencing Mind
“The Universal Optimism of the Self-Evidencing Mind“:Karl Friston’s free-energy principle casts agents as self-evidencing through active inference. This implies that decision-making, planning and information-seeking are, in a generic sense, ‘wishful’. We take an interdisciplinary perspective on this perplexing aspect of the free-energy principle and unpack the epistemological implications of wishful thinking under the free-energy principle.…
-
Energy cost of computation: stochastic thermodynamics?
“Is stochastic thermodynamics the key to understanding the energy costs of computation?” The relationship between the thermodynamic and computational properties of physical systems has been a major theoretical interest since at least the 19th century. It has also become of increasing practical importance over the last half-century as the energetic cost of digital devices has…
-
Communicate Unflattening
I already mentioned in a previous blog entry the “Krebs Cycle of Creativity“, a map that describes the perpetuation of creative energy, analogous to the Krebs Cycle proper. In this analogy of the Krebs Cycle, the four modalities of human creativity— Science, Engineering, Design and Art— replace the Krebs Cycle’s carbon compounds. Each of the modalities…
-
Functional Trade-offs in Cognition
“Basic Functional Trade-offs in Cognition: An Integrative Framework” by Marco Del Giudice and Bernard J. Crespi, 2018. Trade-offs between advantageous but conflicting properties (e.g., speed vs. accuracy) are ubiquitous in cognition, but the relevant literature is conceptually fragmented, scattered across disciplines, and has not been organized in a coherent framework. This paper takes an initial step toward a general…
-
Nature heals
“Nature heals: An informational entropy account of self-organization and change in field psychotherapy“Highlights This paper reviews biophysical models of psychotherapeutic change based on synergetics and the free energy principle. These models suggest that introducing sensory surprise into the patient-therapist system can lead to self-organization and the formation of new attractor states, disrupting entrenched patterns of…
-
Affect-centered account of motivated behavior
“The affective gradient hypothesis: an affect-centered account of motivated behavior“: everyone agrees that feelings and actions are intertwined, but cannot agree how. According to dominant models, actions are directed by estimates of value and these values shape or are shaped by affect. The article proposes instead that affect is the only form of value that…
-
KNOWLEDGE ACQUISITION hindered by KNOWLEDGE ENTROPY DECAY during language model pretraining
This paper describes how a model’s tendency to broadly integrate its parametric knowledge evolves throughout pretraining, and how this behavior affects overall performance, particularly in terms of knowledge acquisition and forgetting. The concept of knowledge entropy is introduced, which quantifies the range of memory sources the model engages with; high knowledge entropy indicates that the…
-
Movement Matters
An Open Access book from MIT press, Movement Matters: How Embodied Cognition Informs Teaching and Learning (available for download). Experts translate the latest findings on embodied cognition from neuroscience, psychology, and cognitive science to inform teaching and learning pedagogy. Embodied cognition represents a radical shift in conceptualizing cognitive processes, in which cognition develops through mind-body…
-
regulation of motivated behavior
in “A unified theoretical framework underlying the regulation of motivated behavior“, Yu-Been Kim, Young Hee Lee, Shee-June Park and Hyung Jin Choi explain that multiple psychological components have evolved in order to orchestrate behaviors for survival. Despite several theories regarding behavior regulation, these theories do not clearly distinguish distinct components and do not explain the…
-
Will We Ever Have Conscious Machines?
The question of whether artificial beings or machines could become self-aware or conscious has been a philosophical question for centuries. The main problem is that self-awareness cannot be observed from an outside perspective and the distinction of being really self-aware or merely a clever imitation cannot be answered without access to knowledge about the mechanism’s…
