Category: Information Technology

• KNOWLEDGE ACQUISITION hindered by KNOWLEDGE ENTROPY DECAY during language model pretraining

  This paper describes how a model’s tendency to broadly integrate its parametric knowledge evolves throughout pretraining, and how this behavior affects overall performance, particularly in terms of knowledge acquisition and forgetting. The concept of knowledge entropy is introduced, which quantifies the range of memory sources the model engages with; high knowledge entropy indicates that the…

  walterstiers

  2024-10-13

  AI, Information Technology

  #DecisionIntelligence, #TheInformationLens, AI, entropy, philosophy, physics, Science

• Will We Ever Have Conscious Machines?

  The question of whether artificial beings or machines could become self-aware or conscious has been a philosophical question for centuries. The main problem is that self-awareness cannot be observed from an outside perspective and the distinction of being really self-aware or merely a clever imitation cannot be answered without access to knowledge about the mechanism’s…

  walterstiers

  2024-09-24

  AI, Biology of Information, Complexity, Information Technology, Science

  #DecisionIntelligence, #HumanAI, #TheInformationLens, #Uncertainty

• Slow productivity — here’s why you should adopt it…

  The full title is “Slow productivity worked for Marie Curie — here’s why you should adopt it, too“, and yes, it is referring to the book from Cal Newport, I already mentioned a while ago. “… figure out how you can leverage the autonomy you have and how you organize your labour to get away…

  walterstiers

  2024-08-06

  #Sensemaking, Complexity, Creative Thinking, Information Technology, Life Ideas, Science, Social-Technical

  #DecisionIntelligence, #ProblemSolvingMind, #TheInformationLens

• Facts Don’t – Stories Do

  I want to share the great article on LSE by Anna Toomey on “Facts Don’t Change Minds – Social Networks, Group Dialogue, and Stories Do”, based upon the author’s article Why facts don’t change minds: Insights from cognitive science for the improved communication of conservation research, published in Biological Conservation. It is counterintuitive (and not a…

  walterstiers

  2024-07-08

  #sense-making, Biology of Information, Complexity, Creative Thinking, Information Technology, Science, Social-Technical

  #DecisionIntelligence, #TheInformationLens, education, philosophy, Science, Sustainability

• An Informational Approach to Emergence

  Claudio Gnoli gives an updated view on emergence in “Foundations of Science“ Emergence can be described as a relationship between entities at different levels of organization, that looks especially puzzling at the transitions between the major levels of matter, life, cognition and culture. Indeed, each major level is dependent on the lower one not just…

  walterstiers

  2024-05-21

  #sense-making, #Sensemaking, #stakeholder economy, Complexity, Decision Intelligence, Information Technology, Social-Technical

  #DecisionIntelligence, #emergence, #TheInformationLens, epistemology, ontology

• On principles of emergent organization

  Adam Rupe, James P. Crutchfield published “On principles of emergent organization“: After more than a century of concerted effort, physics still lacks basic principles of spontaneous self-organization. To appreciate why, we first state the problem, outline historical approaches, and survey the present state of the physics of self-organization. This frames the particular challenges arising from mathematical intractability and…

  walterstiers

  2024-05-07

  #sense-making, #Wicked, Complexity, Information Technology

  #DecisionIntelligence, #TheInformationLens, #Wicked, entropy, physics, Science, thermodynamics

• Why the simplest explanation isn’t always the best

  Eva L. Dyer and Konrad Kording discuss in a commentary article “Why the simplest explanation isn’t always the best” an essential learning related to the article Phantom oscillations in principal component analysis (also available on BioRXiv) Dimensionality reduction simplifies high-dimensional data into a small number of representative patterns. One dimensionality reduction method, principal component analysis (PCA), often selects oscillatory…

  walterstiers

  2024-04-18

  Biology of Information, Complexity, Information Technology, Neurobiology/psychology, Science

  #DecisionIntelligence, #TheInformationLens, AI, artificial-intelligence, data-science, machine-learning, unsupervised-learning

• Your Name Matters (this is not a joke)

  Best student paper award at the 2023 ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO’23) was “30 Million Canvas Records Reveal Widespread Sequential Bias and System-design Induced Surname Initial Disparity in Grading” authored by Jiaxin Pei, Zhihan Wang, and Jun Li. The widespread adoption of learning management systems in educational institutions has…

  walterstiers

  2024-04-18

  #Sensemaking, Complexity, Information Technology, Policy, Science, Social-Technical

  #DecisionIntelligence, #TheInformationLens, assessment, education

• Novel beings, novel goals

  Every now and then there is the opportunity to get the a clear overview on the actual state of research on biology, intelligence, the artificial and it’s overlap towards future capabilities. “Novel beings, novel goals: evolution & engineering of the agential material of life | Dr. Mike Levin‘ is available on youtube. Dr. Michael Levin…

  walterstiers

  2024-03-19

  Biology of Information, Complexity, Information Technology, Innovation Games, Life Ideas, Science

  #DecisionIntelligence, #emergence, #TheInformationLens

• the problem of algorithmic recommendations

  I just want to point out an MIT Technology Review article on three new books warn against turning into the person the algorithm thinks you are “A machine-learning algorithm walks into a bar. The bartender asks: ‘What’ll you have?’ The algorithm says: ‘What’s everyone else having?’” Chet Haase (Google) Software engineer Chet Haase’s joke sums…

  walterstiers

  2024-03-12

  #sense-making, AI, Decision Intelligence, Information Technology, Policy, Social-Technical

  #DecisionIntelligence, #HumanAI, #TheInformationLens, AI, artificial-intelligence, data-science, machine-learning, technology