Category: Information Technology

• KNOWLEDGE ACQUISITION hindered by KNOWLEDGE ENTROPY DECAY during language model pretraining

  This paper describes how a model’s tendency to broadly integrate its parametric knowledge evolves throughout pretraining, and how this behavior affects overall performance, particularly in terms of knowledge acquisition and forgetting. The concept of knowledge entropy is introduced, which quantifies the range of memory sources the model engages with; high knowledge entropy indicates that the…

  walterstiers

  2024-10-13

  AI, Information Technology

  #DecisionIntelligence, #TheInformationLens, AI, entropy, philosophy, physics, Science

• Will We Ever Have Conscious Machines?

  The question of whether artificial beings or machines could become self-aware or conscious has been a philosophical question for centuries. The main problem is that self-awareness cannot be observed from an outside perspective and the distinction of being really self-aware or merely a clever imitation cannot be answered without access to knowledge about the mechanism’s…

  walterstiers

  2024-09-24

  AI, Biology of Information, Complexity, Information Technology, Science

  #DecisionIntelligence, #HumanAI, #TheInformationLens, #Uncertainty

• Slow productivity — here’s why you should adopt it…

  The full title is “Slow productivity worked for Marie Curie — here’s why you should adopt it, too“, and yes, it is referring to the book from Cal Newport, I already mentioned a while ago. “… figure out how you can leverage the autonomy you have and how you organize your labour to get away…

  walterstiers

  2024-08-06

  #Sensemaking, Complexity, Creative Thinking, Information Technology, Life Ideas, Science, Social-Technical

  #DecisionIntelligence, #ProblemSolvingMind, #TheInformationLens

• Facts Don’t – Stories Do

  I want to share the great article on LSE by Anna Toomey on “Facts Don’t Change Minds – Social Networks, Group Dialogue, and Stories Do”, based upon the author’s article Why facts don’t change minds: Insights from cognitive science for the improved communication of conservation research, published in Biological Conservation. It is counterintuitive (and not a…

  walterstiers

  2024-07-08

  #sense-making, Biology of Information, Complexity, Creative Thinking, Information Technology, Science, Social-Technical

  #DecisionIntelligence, #TheInformationLens, education, philosophy, Science, Sustainability

• An Informational Approach to Emergence

  Claudio Gnoli gives an updated view on emergence in “Foundations of Science“ Emergence can be described as a relationship between entities at different levels of organization, that looks especially puzzling at the transitions between the major levels of matter, life, cognition and culture. Indeed, each major level is dependent on the lower one not just…

  walterstiers

  2024-05-21

  #sense-making, #Sensemaking, #stakeholder economy, Complexity, Decision Intelligence, Information Technology, Social-Technical

  #DecisionIntelligence, #emergence, #TheInformationLens, epistemology, ontology

• On principles of emergent organization

  Adam Rupe, James P. Crutchfield published “On principles of emergent organization“: After more than a century of concerted effort, physics still lacks basic principles of spontaneous self-organization. To appreciate why, we first state the problem, outline historical approaches, and survey the present state of the physics of self-organization. This frames the particular challenges arising from mathematical intractability and…

  walterstiers

  2024-05-07

  #sense-making, #Wicked, Complexity, Information Technology

  #DecisionIntelligence, #TheInformationLens, #Wicked, entropy, physics, Science, thermodynamics

• Why the simplest explanation isn’t always the best

  Eva L. Dyer and Konrad Kording discuss in a commentary article “Why the simplest explanation isn’t always the best” an essential learning related to the article Phantom oscillations in principal component analysis (also available on BioRXiv) Dimensionality reduction simplifies high-dimensional data into a small number of representative patterns. One dimensionality reduction method, principal component analysis (PCA), often selects oscillatory…

  walterstiers

  2024-04-18

  Biology of Information, Complexity, Information Technology, Neurobiology/psychology, Science

  #DecisionIntelligence, #TheInformationLens, AI, artificial-intelligence, data-science, machine-learning, unsupervised-learning

• Your Name Matters (this is not a joke)

  Best student paper award at the 2023 ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO’23) was “30 Million Canvas Records Reveal Widespread Sequential Bias and System-design Induced Surname Initial Disparity in Grading” authored by Jiaxin Pei, Zhihan Wang, and Jun Li. The widespread adoption of learning management systems in educational institutions has…

  walterstiers

  2024-04-18

  #Sensemaking, Complexity, Information Technology, Policy, Science, Social-Technical

  #DecisionIntelligence, #TheInformationLens, assessment, education

• Novel beings, novel goals

  Every now and then there is the opportunity to get the a clear overview on the actual state of research on biology, intelligence, the artificial and it’s overlap towards future capabilities. “Novel beings, novel goals: evolution & engineering of the agential material of life | Dr. Mike Levin‘ is available on youtube. Dr. Michael Levin…

  walterstiers

  2024-03-19

  Biology of Information, Complexity, Information Technology, Innovation Games, Life Ideas, Science

  #DecisionIntelligence, #emergence, #TheInformationLens

• the problem of algorithmic recommendations

  I just want to point out an MIT Technology Review article on three new books warn against turning into the person the algorithm thinks you are “A machine-learning algorithm walks into a bar. The bartender asks: ‘What’ll you have?’ The algorithm says: ‘What’s everyone else having?’” Chet Haase (Google) Software engineer Chet Haase’s joke sums…

  walterstiers

  2024-03-12

  #sense-making, AI, Decision Intelligence, Information Technology, Policy, Social-Technical

  #DecisionIntelligence, #HumanAI, #TheInformationLens, AI, artificial-intelligence, data-science, machine-learning, technology

• AI Resources – A Worry

  ChatGPT is the first non-human addition to the list of people who shaped science… But also we have a worry related to this fact, as told in the (Dec.19,2023) Quote of the day “What worries me is we don’t have the resources to make sure that academic AI continues to be a centre of gravity.…

  walterstiers

  2024-01-10

  AI, Complexity, Information Technology, Policy, Science, Uncategorized

  #HumanAI

• The Emerging Science of Interacting Minds

  For over a century, psychology has focused on uncovering mental processes of a single individual. However, humans rarely navigate the world in isolation.The most important determinants of successful development, mental health, and our individual traits and preferences arise from interacting with other individuals. Social interaction underpins who we are, how we think, and how we…

  walterstiers

  2023-12-21

  #sense-making, Biology of Information, Complexity, Information Technology, Neurobiology/psychology, Science, Social-Technical

  #HumanAI, #ProblemSolvingMind, #TheInformationLens

• An New Law Needed?

  On the roles of function and selection in evolving systems - by Michael L. Wong, et al. (2023) Systems of many interacting agents display an increase in diversity, distribution, and/or patterned behavior when numerous configurations of the system are subject to selective pressure. The universe is replete with complex evolving systems, but the existing macroscopic physical laws…

  walterstiers

  2023-12-18

  #sense-making, #Wicked, Biology of Information, Complexity, Decision Intelligence, Information Technology, Life Ideas, Science

  #DecisionIntelligence, #emergence, #TheInformationLens

• Generating meaning – AI²: predicting wor(l)ds

  I would like to quote some of the great insights and statements from the opinion by G. Pezzulo, T. Parr, P. Cisek, A Clark, and K. Friston published in TICS: “Generating meaning: active inference and the scope and limits of passive AI“. Does ChatGPT ‘understand‘ what it talks about in the way we do, or…

  walterstiers

  2023-11-27

  #sense-making, Active Inference, AI, Biology of Information, Complexity, Information Technology, Life Ideas, Neurobiology/psychology, Science

  #ActiveInference, #DecisionIntelligence, #HumanAI, #TheInformationLens

• The Future of Artificial Intelligence by Melanie Mitchell

  AI is all around us recognizing our faces in photos, transcribing our speech, constructing our news feeds, navigating our driving routes, answering our search queries, and much more. But rapidly improving AI is poised to play a much bigger role in all of our lives. In this lecture, AI expert Melanie Mitchell demystifies how current-day…

  walterstiers

  2023-11-16

  #Sensemaking, AI, Complexity, Decision Intelligence, Information Technology, Science

  #DecisionIntelligence, #HumanAI, #TheInformationLens, #Wicked

• Morphing our view on the world

  Map projections are a way of representing regions on the surface of a spherical object on a flat surface. For example, a continent on the Earth can be represented on a flat map. There are many map projections, but some are more prevalent in our work with scientific visualization data. Map projections are chosen based…

  walterstiers

  2023-10-31

  Information Technology, Science

• EXplore-versus-EXploit problems

  Trade-offs between producing costly movements for gathering information (‘explore’) and using previously acquired information to achieve a goal (‘exploit’) arise in a wide variety of problems, including foraging, reinforcement learning and sensorimotor control. Determining the optimal balance between exploration and exploitation is computationally intractable, necessitating heuristic solutions. In “Mode switching in organisms for solving explore-versus-exploit…

  walterstiers

  2023-10-31

  #Sensemaking, #Wicked, Biology of Information, Decision Intelligence, Information Technology, Life Ideas, Neurobiology/psychology, Science

  #DecisionIntelligence, #EconomicBehavior, #emergence, #ProblemSolvingMind, #TheInformationLens

• Conceptual Bootstrapping (human cognition)

  To tackle a hard problem, it is often wise to reuse and recombine existing knowledge. Such an ability to bootstrap enables us to grow rich mental concepts despite limited cognitive resources. This article presents a computational model of conceptual bootstrapping. This model uses a dynamic conceptual repertoire that can cache and later reuse elements of…

  walterstiers

  2023-10-31

  #Sensemaking, #Wicked, Active Inference, Biology of Information, Information Technology, Neurobiology/psychology

  #ActiveInference, #DecisionIntelligence, #emergence, #HumanAI, #ProblemSolvingMind, #TheInformationLens

• Cognitive distortions in recent decades

  Cognitive distortions are thinking patterns that are strongly associated with internalizing disorders such as depression and anxiety. Historical traces of in millions of books published over the course of the last two centuries in English, Spanish, and German show a pronounced “hockey stick” pattern: Over the past two decades the textual analogs of cognitive distortions…

  walterstiers

  2023-10-30

  #Sensemaking, #Wicked, Complexity, Creative Thinking, Information Technology, Life Ideas, Neurobiology/psychology, Science, Social-Technical

  #emergence, #TheInformationLens, #Uncertainty

• The computational power of the human brain

  Peter J. Gebicke-Haerter published a great review article with this title. I selected some snippets and the key conclusion: At the end of the 20th century, analog systems in computer science have been widely replaced by digital systems due to their higher computing power. Nevertheless, the question keeps being intriguing until now: is the brain…

  walterstiers

  2023-08-28

  Biology of Information, Complexity, Information Technology, Life Ideas, Neurobiology/psychology, Science

  #DecisionIntelligence, #emergence, #ProblemSolvingMind, #TheInformationLens

• Conducting unveiled

  “Conducting unveiled: Sharing Simon Rattle’s Vision through Revolutionary EyeTracking Glasses” is a wonderfull story, I would like to share. “Split second shifts give the conductor and musicians a chance to anticipate the next move, but on a much larger, integrally collective scale.” This story brings together some together some topics already touched before, like conducting…

  walterstiers

  2023-08-27

  #sense-making, Active Inference, Biology of Information, Complexity, Information Technology, Innovation Games, Life Ideas, Neurobiology/psychology, Science, Social-Technical

  #DecisionIntelligence, #emergence, #TheInformationLens

• Harris Hawks Optimization

  The Harris hawk optimizer is a recent population-based metaheuristics algorithm that simulates the hunting behavior of hawks. This swarm-based optimizer performs the optimization procedure using a novel way of exploration and exploitation and the multiphases of search. A review research focuses on the applications and developments of the recent well-established robust optimizer Harris hawk optimizer…

  walterstiers

  2023-08-10

  Complexity, Decision Intelligence, Information Technology, Science

  #DecisionIntelligence, #ProblemSolvingMind, #TheInformationLens

• What If – Causal Inference (free)

  Miguel Hernán made a revision of book “Causal Inference: What If” is available for download. The book provides a cohesive presentation of concepts of, and methods for, causal inference. Much of this material is currently scattered across journals in several disciplines or confined to technical articles. The authors expect that the book will be of…

  walterstiers

  2023-08-10

  Decision Intelligence, Information Technology, Science

  #DecisionIntelligence, #TheInformationLens

• Design for Well-Being and Sustainability

  Design for Well-Being and Sustainability: A Conceptual Framework of the Peer-to-Peer Sharing and Reuse Platform in the Circular Economy investigates how to infuse well-being components into the circular economy. Based on the literature review, it organized and analyzed the extant evidence of related well-being-based research to develop an ecosystem model of a sustainable product–service system…

  walterstiers

  2023-08-06

  #sense-making, Active Inference, AI, Biology of Information, Complexity, Decision Intelligence, Information Technology, Life Ideas, Neurobiology/psychology, Policy, Science, Social-Technical

  #ActiveInference, #DecisionIntelligence, #emergence, #HumanAI, #TheInformationLens