Tag: physics
-
misguidedly radical ideas?
“Is bad philosophy holding back physics?“ Carlo Rovelli states:“My hunch is that it is at least partly because physicists are bad philosophers. Scientists’ opinions, whether they realize it or not (and whether they like it or not), are imbued with philosophy. And many of my colleagues — especially those who argue that philosophy is irrelevant…
-
Power of the Invisible
“The Power of the Invisible: The Quantessence of Reality” from Sander Bais There are two possible outcomes: if the result confirms the hypothesis, then you’ve made a measurement. If the result is contrary to the hypothesis, then you’ve made a discovery. Enrico Fermi Quantum Physics is the solid basis of most of our understanding of…
-
Energy cost of computation: stochastic thermodynamics?
“Is stochastic thermodynamics the key to understanding the energy costs of computation?” The relationship between the thermodynamic and computational properties of physical systems has been a major theoretical interest since at least the 19th century. It has also become of increasing practical importance over the last half-century as the energetic cost of digital devices has…
-
KNOWLEDGE ACQUISITION hindered by KNOWLEDGE ENTROPY DECAY during language model pretraining
This paper describes how a model’s tendency to broadly integrate its parametric knowledge evolves throughout pretraining, and how this behavior affects overall performance, particularly in terms of knowledge acquisition and forgetting. The concept of knowledge entropy is introduced, which quantifies the range of memory sources the model engages with; high knowledge entropy indicates that the…
-
On principles of emergent organization
Adam Rupe, James P. Crutchfield published “On principles of emergent organization“: After more than a century of concerted effort, physics still lacks basic principles of spontaneous self-organization. To appreciate why, we first state the problem, outline historical approaches, and survey the present state of the physics of self-organization. This frames the particular challenges arising from mathematical intractability and…
Surtil : 