Tag: philosophy
-
The power of mathematical models for better policy decisions
“Harnessing the power of mathematical models for better policy decisions” sets out four practical recommendations to help policymakers across a wide range of policy areas effectively capitalise on, and sidestep pitfalls of, using mathematical models for decision-making. Decision-makers are often keen to “follow the science” in highly-charged contexts such as climate policy, pandemic response, economic…
-
Power of the Invisible
“The Power of the Invisible: The Quantessence of Reality” from Sander Bais There are two possible outcomes: if the result confirms the hypothesis, then you’ve made a measurement. If the result is contrary to the hypothesis, then you’ve made a discovery. Enrico Fermi Quantum Physics is the solid basis of most of our understanding of…
-
Greatness Cannot Be Planned
Why does modern life revolve around objectives? From how science is funded, to improving how children are educated — and nearly everything in-between — our society has become obsessed with a seductive illusion: that greatness results from doggedly measuring improvement in the relentless pursuit of an ambitious goal. In Why Greatness Cannot Be Planned—The Myth of…
-
Is Ockham’s razor losing its edge?
Is Ockham’s razor losing its edge? New perspectives on the principle of model parsimony The preference for simple explanations, known as the parsimony principle, has long guided the development of scientific theories, hypotheses, and models. Yet recent years have seen a number of successes in employing highly complex models for scientific inquiry (e.g., for 3D…
-
The power of parsimony
“Walking the talk on multi-level interventions: The power of parsimony“ There is strong consensus regarding the need for multi-level interventions (MLIs) to address today’s complex health problems. The greatest public health burdens globally (e.g., chronic and infectious diseases) derive from a mix of causal and contributing factors and are inherently complex, operating interdependently and reflexively…
-
The Universal Optimism of the Self-Evidencing Mind
“The Universal Optimism of the Self-Evidencing Mind“:Karl Friston’s free-energy principle casts agents as self-evidencing through active inference. This implies that decision-making, planning and information-seeking are, in a generic sense, ‘wishful’. We take an interdisciplinary perspective on this perplexing aspect of the free-energy principle and unpack the epistemological implications of wishful thinking under the free-energy principle.…
-
Energy cost of computation: stochastic thermodynamics?
“Is stochastic thermodynamics the key to understanding the energy costs of computation?” The relationship between the thermodynamic and computational properties of physical systems has been a major theoretical interest since at least the 19th century. It has also become of increasing practical importance over the last half-century as the energetic cost of digital devices has…
-
Nature heals
“Nature heals: An informational entropy account of self-organization and change in field psychotherapy“Highlights This paper reviews biophysical models of psychotherapeutic change based on synergetics and the free energy principle. These models suggest that introducing sensory surprise into the patient-therapist system can lead to self-organization and the formation of new attractor states, disrupting entrenched patterns of…
-
KNOWLEDGE ACQUISITION hindered by KNOWLEDGE ENTROPY DECAY during language model pretraining
This paper describes how a model’s tendency to broadly integrate its parametric knowledge evolves throughout pretraining, and how this behavior affects overall performance, particularly in terms of knowledge acquisition and forgetting. The concept of knowledge entropy is introduced, which quantifies the range of memory sources the model engages with; high knowledge entropy indicates that the…
-
Insight –> selection of ideas
“Insight and the selection of ideas” describes the mechanisms underlying Eureka heuristic, explained within an active inference framework. Perhaps it is no accident that insight moments accompany some of humanity’s most important discoveries in science, medicine, and art. Here we propose that feelings of insight play a central role in (heuristically) selecting an idea from…
-
Representation of priors and decisions
The PLOS article by Marshall, Ruesseler, Hunt, O’Reilly “representation of priors and decisions in the human parietal cortex” discusses how both humans and animals actively sample the environment using their sensory organs, far from being passive recipients of sensory information. In rodents, active sampling processes include whisking and sniffing; in primates, the most important and…
