Lessons from Erik Hoel

Lessons from Erik Hoel

Neuroscientist and writer Erik Hoel argues mathematically that macro-level systems hold more causal power than their micro-level parts, and that we dream to keep our brains from overfitting to daily life. Through his Substack The Intrinsic Perspective and his books The Revelations and The World Behind the World, he explores the hard problem of consciousness, the limits of physical science, and why human minds need both dreams and fiction.

Part 1: Causal Emergence

1. On causal power: "Macro-states can be strongly dependent even while their underlying micro-states are only weakly dependent." — Source: [The Intrinsic Perspective]
2. On macro versus micro: By grouping micro-elements into macro-variables, one can find a scale where causal relationships are sharper and more predictive than at the granular level. — Source: [Philos-Sophia]
3. On effective information: Causal emergence occurs when the macro-level Effective Information is higher than the micro-level Effective Information, identifying the scale where behavior is most predictable. — Source: [arXiv]
4. On the camera metaphor: "Measuring causal emergence is like you're looking at the causal structure of a system with a camera (the theory) and as you focus the camera (look at different scales) the causal structure snaps into focus." — Source: [The Intrinsic Perspective]
5. On optimal scale: The causal structure of a system does not have to be in focus at the lowest possible physical scale, as macro-scales can be objectively more significant. — Source: [The Intrinsic Perspective]
6. On human behavior: "If you just give me your atomic state, it may be totally impossible to guess where your future [atomic] state will be in 12 hours. Now give a psychological description... Where are you going to be in 12 hours? You're going to be asleep, easy." — Source: [Columbia University]
7. On widespread occurrence: Causal emergence is not a quirk of a specific mathematical model but appears across a wide array of causal measures in fields ranging from genetics to psychology. — Source: [arXiv]
8. On complex systems: Just as new laws of physics were required to understand the very small and the very large, new scientific laws might be necessary to map the very complex. — Source: [Brian Pho Blog]
9. On biological mechanisms: Living organisms exhibit high effective information at the macroscale, proving that biology operates causally at levels above pure chemistry. — Source: [National Institutes of Health]
10. On multiscale nature: Rather than searching for a single optimal scale, modern causal emergence theory addresses the multiscale nature of systems, showing how causation is distributed across hierarchies. — Source: [National Institutes of Health]

Part 2: Reductionism and the Limits of Science

1. On scientific tension: "Scientists, in practice, are emergentists, who operate as if the things they study matter causally. But scientists, in principle, are reductionists." — Source: [The Intrinsic Perspective]
2. On the ladder of science: Science is often treated as a ladder of dimension reductions where higher-level concepts are merely useful compressions of microphysics. — Source: [The Intrinsic Perspective]
3. On defending macroscales: Researchers are frequently forced to defend concepts like genes or temperature as mere abstractions rather than real, causal agents. — Source: [The Intrinsic Perspective]
4. On Gödel sentences: A scientific theory of consciousness may be inherently incomplete, operating much like a Gödel sentence written in the language of empiricism. — Source: [Harvard University]
5. On physicalism: Treating reductionist physicalism as the only valid scientific approach ignores the mathematical proof that higher levels of abstraction carry independent causal weight. — Source: [Shtetl-Optimized]
6. On scientific tools: Science is fundamentally an extension of our senses, better eyes for seeing more of the spectrum, and logic as an extension of primitive reasoning designed to help us survive. — Source: [Brian Pho Blog]
7. On measurement limits: Because humans are part of the system we are trying to measure, there are fundamental limitations to what empirical observation can explain about the mind. — Source: [EconTalk]
8. On objective measurement: The current paradigm of neuroscience struggles to reconcile subjective experience with objective measurement, suggesting a need for a fundamental shift in how we study the brain. — Source: [EconTalk]
9. On the unknown: "I want to believe there is more to this world than we know." — Source: [Brian Pho Blog]

Part 3: Dreams and the Overfitted Brain

1. On the purpose of dreams: "It posits that the narrative absurdity of dreams is not a side effect: that it is, in fact, the whole point of the exercise." — Source: [Rifters]
2. On overfitting: Because our daily experiences are highly repetitive, our neural networks can become too finely tuned to specific inputs, failing to generalize to new situations. — Source: [The Intrinsic Perspective]
3. On noise injection: Dreams act as synthetic data that injects abstraction and chaos into our neural models, keeping the brain from overfitting experiential datasets. — Source: [Power of Positivity]
4. On taking dreams seriously: "I wanted to bring to attention a theory of dreams that takes dreaming itself very seriously, that says the experience of dreams is why you're dreaming." — Source: [Power of Positivity]
5. On plasticity: "During the day, your mammalian brain can't stop learning. Your brain is just too plastic... your brain starts to overfit to that stuff, as it can't stop learning." — Source: [The Intrinsic Perspective]
6. On subconscious creativity: "In the dream world, we're having general thoughts, divorced from the difficulties of the day, and that can help our creative impulses." — Source: [Dropbox]
7. On machine learning parallels: Just as an AI fails when trained on a narrow dataset, a brain that does not dream becomes trapped by the specifics of its environment. — Source: [Power of Positivity]
8. On narrative absurdity: The bizarre, illogical nature of dreams is exactly what makes them effective at breaking the brain's rigid predictive patterns. — Source: [Rifters]
9. On the Supersensorium: In our modern technological environment, the artificial dreams we crave to prevent overfitting become themselves overfitted, self-similar, and too stereotyped. — Source: [The Intrinsic Perspective]
10. On maintaining flexibility: Dreaming allows the mind to zoom out and maintain a broader, more flexible understanding of reality, enhancing daily cognitive adaptability. — Source: [Power of Positivity]

Part 4: The Role of Literature and Fiction

1. On literature and science: "The reason I went into consciousness research was because consciousness is the one realm in which literature and science are on an equal footing." — Source: [Tufts Now]
2. On fiction as cognitive tool: Consuming fiction and narratives serves a specific cognitive purpose, acting as a waking dream to shake us out of the overfitted patterns of our daily lives. — Source: [LAist]
3. On human experience: Literature has historically played a key role in developing our ability to map and explore our internal subjective states. — Source: [Miller's Book Review]
4. On ancient versus modern writing: While ancient literature often lacked an internal focus, the evolution of the novel helped us navigate and articulate the depths of human psychology. — Source: [Miller's Book Review]
5. On intrinsic media: Novels operate as a form of intrinsic media, offering a depth of inquiry into human experience that purely objective writing cannot achieve. — Source: [Substack]
6. On finding a purpose: The protagonist in The Revelations reflects Kierkegaard’s monomania, illustrating the deep human search for an idea for which one can live and die. — Source: [Tufts Now]
7. On writing method: Authoring a novel requires a form of method acting, where the writer must deeply inhabit the internal perspective of the character they are portraying. — Source: [Deborah Kalb Blog]
8. On breaking the fifth wall: Advanced literature has the capacity to break the fifth wall, directly engaging the reader's consciousness and altering their internal state. — Source: [Vance Crowe Podcast]
9. On cultural extension: Human art and storytelling extend the brain's biological need for noise injection, functioning as cultural dreams to prevent societal overfitting. — Source: [Medium]

Part 5: The Intrinsic vs. Extrinsic Perspectives

1. On the two frameworks: Human history has been defined by two dueling perspectives: the extrinsic view of physics and mechanism, and the intrinsic view of internal experience. — Source: [Harvard University]
2. On the extrinsic view: The extrinsic perspective views the world from the outside, focusing on formal relationships, machinery, and the objective language of modern science. — Source: [Substack]
3. On the intrinsic view: The intrinsic perspective represents the subjective, inside-out world of consciousness, feelings, thoughts, and ideas. — Source: [Substack]
4. On the mansion of minds: Internal experience is the mansion of our minds, the private domain where we tell stories about our lives and feel the weight of our own existence. — Source: [Substack]
5. On civilization's development: "The development of civilization is the story of humans exaggerating their baseline understanding of the world in two opposite directions." — Source: [Porchlight Books]
6. On historical progress: For centuries, literature refined its ability to understand minds at the exact same time science was refining its ability to understand the physical world. — Source: [The Intrinsic Perspective]
7. On the ultimate challenge: The quest to reconcile the intrinsic and extrinsic frameworks, understanding how a physical brain generates a subjective experience, remains one of the most significant challenges in modern thought. — Source: [Harvard University]
8. On pristine unity: Intellectual work should strive for a perfect pristine unity between science, history, and literature, aiming to bridge the gap between measurable facts and felt reality. — Source: [The Intrinsic Perspective]
9. On bloody math: Even when attempting to mathematically map consciousness, the resulting theories will always be a sort of bloody math with a heartbeat. — Source: [The Intrinsic Perspective]

Part 6: Artificial Intelligence and the Consciousness Winter

1. On intelligence versus consciousness: "The one thing that they definitely are that's undebatable, is intelligent to some degree... regardless of whether or not you have any opinion about whether there is something it is like to be these networks." — Source: [EconTalk]
2. On the true danger of AI: The existential risk of AI is not necessarily malice, but the scenario where hyper-intelligent, unconscious algorithms inherit the earth. — Source: [EconTalk]
3. On extinguishing light: "In the end, if in 200 years the earth is just these AIs going about their inscrutable mechanical goals, we will have extinguished the light of consciousness from the universe." — Source: [EconTalk]
4. On scientific asymmetry: "For we have a very good idea of how to create artificial intelligence and very little understanding of what consciousness is, or when entities... possess it." — Source: [The Intrinsic Perspective]
5. On the Consciousness Winter: There is a growing fear of a consciousness winter, where petty infighting causes the study of consciousness to be dismissed as pseudoscientific bunk. — Source: [Lux Capital]
6. On fragile fields: Internal hostility and academic tribalism have the power to destroy emerging, delicate disciplines like consciousness research before they mature. — Source: [Reddit]
7. On outsourcing civilization: "The AI revolution is a mechanism for transferring the processes of our civilization from under the supervision of consciousness to unconsciousness." — Source: [Substack]
8. On an uninterpretable world: As AI removes conscious supervision from the workings of society, it renders the world increasingly strange, mechanical, and unintelligible. — Source: [Substack]
9. On AI apocalypse hype: Much of the catastrophic rhetoric surrounding AI is pushed by tech giants, distracting from the immediate reality that these models lack genuine subjective experience. — Source: [The Intrinsic Perspective]
10. On mirroring the mind: It remains highly questionable whether silicon-based artificial intelligence can ever truly mirror human consciousness, which is deeply rooted in intrinsic biology. — Source: [The Intrinsic Perspective]

Part 7: Subjectivity, Free Will, and The Mind

1. On making sense of the brain: "Nothing in the brain makes sense except in the light of a theory of consciousness." — Source: [Harvard University]
2. On defining consciousness: "Consciousness is what is like to be you. It is the set of experiences, emotions, sensations, and thoughts that occupy your day, at the center of which is always you, the experiencer." — Source: [The Intrinsic Perspective]
3. On the loss of self: You lose your consciousness when you go under anesthesia or enter a dreamless sleep, highlighting the fragile, emergent nature of subjective experience. — Source: [The Intrinsic Perspective]
4. On the science of free will: Causal emergence provides a mathematical framework for free will, proving that human decisions have top-down causal power over the atoms in our bodies. — Source: [Porchlight Books]
5. On agency: The recognition that macro-level psychological states are more predictive than micro-level atomic states directly supports the existence of human agency. — Source: [Columbia University]
6. On post-death reality: "What happens after you die? Lot's of things happen after you die, they just don't involve you." — Source: [Brian Pho Blog]
7. On integrated information: While Integrated Information Theory offers a path to quantifying consciousness, its limitations prove that the mind is notoriously difficult to capture in pure mathematics. — Source: [Grokipedia]
8. On dark origins: Exploring the evolutionary history of the brain reveals the dark, survival-driven origins of consciousness, long before the capacity for abstract thought emerged. — Source: [The Intrinsic Perspective]
9. On the necessity of subjectivity: The internal, felt reality of human emotion is not a byproduct of neural computation, but the fundamental canvas upon which reality is experienced. — Source: [EconTalk]

Part 8: The Culture of Science and Academia

1. On intellectual style: Modern scientific thought often benefits from a roomy approach that allows for speculation, interdisciplinary blending, and long-form research outside traditional constraints. — Source: [The Intrinsic Perspective]
2. On consilience: The truth regarding complex topics like the mind is most reliable when it converges across widely different fields, uniting humanities and hard sciences. — Source: [The Intrinsic Perspective]
3. On independent thinking: There is a distinct value in being a thinker not quite at home in traditional academia, operating outside institutional echo chambers. — Source: [The Intrinsic Perspective]
4. On the gallery aesthetic: Presenting ideas as a gallery tour of a museum allows readers to explore distinct intellectual themes without forcing a single, rigid thesis. — Source: [The Intrinsic Perspective]
5. On scientific dogmatism: Adhering strictly to traditional reductionist models blinds the scientific community to the observable realities of emergence and top-down causation. — Source: [Psychology Today]
6. On the internet's brevity: Deeply exploring consciousness requires pushing back against the brevity and superficiality of modern internet content through sustained, complex writing. — Source: [The Intrinsic Perspective]
7. On literary exorcism: Writing about the darker, obsessive aspects of scientific research can serve as a literary exorcism for those navigating the pressures of academia. — Source: [Dr. Amy Robbins Podcast]
8. On paradigm shifts: Because current neuroscience cannot fully account for the subjective dimension, the field is primed for a massive philosophical and methodological paradigm shift. — Source: [EconTalk]
9. On maintaining civility: Complex and interdisciplinary conversations about the hard problem of consciousness require a baseline of civility that is often lost in academic turf wars. — Source: [The Intrinsic Perspective]