What Is Consciousness For? The Optimization Theory
By Eugene Sandugey · · 13 min read
Close your eyes. Notice that there's somebody noticing. That's the mystery. Not the brain activity. Not the neural patterns. The fact that there's something it feels like to be you.
What is the hard problem of consciousness?
The hard problem of consciousness is the question of why physical processes in the brain produce subjective experience. We can explain which neurons fire during which tasks (the "easy problems"). What nobody can explain is why any of that processing feels like something from the inside. David Chalmers named this gap in 1995 and it remains open. This page offers a specific answer: experience IS optimization running on a neural substrate. No gap between process and experience. They are the same thing viewed from outside and inside.
We've mapped the brain. We know which regions activate during which tasks. We can predict behavior from scans. What we can't explain is why any of this produces experience. Why isn't the brain just a biological machine running in the dark, with nobody home?
If your reflex is "nobody has proven what consciousness is, therefore any claim about it is unproven," you're right. But apply that standard consistently. Integrated Information Theory hasn't proven experience IS integrated information. Global Workspace Theory hasn't proven experience IS global broadcasting. Physicalism hasn't proven experience IS brain activity. NOBODY has proven their core claim about consciousness. That's the state of the entire field, not a unique weakness of this framework. The question isn't which theory has proven its claim (none have). The question is which theory makes testable predictions that the others don't.
The answer is direct: consciousness is the universe experiencing itself through whatever substrate is doing the optimizing. At neural scale, that's what we call human consciousness. At chemical scale, it's what reactions "experience" when they flow toward stable states. At stellar scale, it's what fusion does. Consciousness is not the only way the universe optimizes. It's one scale among many. If the core argument holds, these are consequences, not premises. The proof works without them.
What consciousness does
Standard science says consciousness "emerges" from brain complexity. That's true as a description but empty as an explanation (why does complexity produce experience?). Here's what consciousness actually does:
Simulation. Your brain runs "what if?" scenarios constantly. Right now, you might be imagining what would happen if you took a new job, or moved to another city, or said something different yesterday. A 2020 Queen's University study (Tseng and Poppenk) measured roughly 6,200 distinct thought transitions per day. Not all of these are future-simulations; many are shifts in attention, memory retrievals, or sensory reactions. But the sheer volume of mental state changes shows how much processing the brain does, and a substantial fraction involves counterfactual reasoning.
Why this matters for optimization: every process below the level of consciousness aims at local equilibria. A rock settles into its minimum energy state. Chemical reactions land on stable bonds. For stars, hydrostatic equilibrium is the target. Nothing below consciousness has a mechanism for aiming at far-from-equilibrium configurations. A rocket on Mars is nowhere near any local equilibrium. No chemistry builds it. No thermodynamics points at it. The only way the universe reaches a state like that is through a system that can imagine it first. Imagination specifies targets that the substrate alone would never select. That's why consciousness exists at this scale: it extends optimization to places physics wouldn't otherwise go.
Error detection. Pain, discomfort, cognitive dissonance. These are emergent properties of biology: organisms with negative feedback outcompete organisms without it. There is only positive pressure: toward optimization. Everything negative is emergent, not purposeful. See Why Does Suffering Exist?
Creative exploration. Art, music, mathematics, fiction: these explore abstract spaces that deterministic physics hasn't tried. That's how the universe discovers things it couldn't predict.
Measurement. In quantum mechanics, "measurement" means any interaction that forces a quantum system to settle into a definite state. A detector does this. A stray photon does this. A rock hitting another rock does this. Consciousness has no special quantum powers.
But brains are prolific measurers. Every time you see, hear, or touch something, quantum systems commit to definite outcomes. Billions of times per second, directed by selective attention toward whatever the brain is optimizing for. The difference between a rock's measurements and a brain's is quantitative, not qualitative: a brain makes more measurements, faster, directed at whatever it's trying to figure out. Any detector collapses wavefunctions. Brains are detectors that also optimize what they detect next.
This is standard physics, not mysticism. This is NOT the claim that the brain is a quantum computer (Penrose-Hameroff). The claim is that brains measure at enormous scale and with selective direction, and measurement matters in quantum mechanics.
Every measurement creates entanglement between the measuring system and what it measures. If entanglement is the construction material of spacetime, then every act of observation adds threads to the fabric. Conscious brains are doing this billions of times per second, directed by attention. The universe accumulates entanglement over time. Conscious observers accelerate that accumulation in the directions they choose to look.
Is consciousness an illusion?
No. Consciousness is not an illusion, a trick, or an artifact of complexity. It is what optimization looks like from the inside. When a neural network runs prediction, error correction, and creative exploration, the process itself has a perspective. Calling it an illusion pushes the question back one step (who is being fooled by the illusion?) without answering it. The framework says: take experience at face value. It is real, it is physical, and it serves a specific function.
Why does consciousness exist?
Consciousness exists because the universe's optimization process needs local agents that can simulate futures, detect errors, and explore possibilities that deterministic physics hasn't tried. A rock optimizes passively. A bacterium optimizes chemically. A brain optimizes by running "what if?" scenarios in real time. Consciousness is what that process feels like from inside the system doing it. For the practical implications at human scale (how to use this view in your own decisions), see What It Means for You.
Why not everywhere?
If consciousness is a useful optimization tool, why isn't it built into every scale? Why don't rocks imagine, why don't chemical reactions run what-if simulations, why don't stars plan ahead?
Two conditions have to be met, and most scales don't meet either one.
First, problem space. Consciousness is how an optimization process reaches far-from-equilibrium targets, configurations the substrate wouldn't aim at on its own. A rock's optimization problem is "settle into a stable configuration." Thermodynamics handles that. The local energy minimum IS the target for a rock. Nothing needs imagining. Chemistry's problem is "form stable bonds." Same story. Neural-scale organisms live in a different problem space. Survival requires reaching configurations thermodynamics wouldn't produce on its own, like a rabbit avoiding a predator it hasn't seen yet, or a human building tools for problems that don't exist yet. These are far-from-equilibrium targets. The only way to reach them is to simulate futures, pick one, and act toward it. That is what imagination does. Consciousness shows up where the problem requires it.
Second, substrate. Consciousness requires integrated information processing through time. A rock has state changes but no integration. Bacteria manage a small amount of it. Jump to mammals and there is orders of magnitude more. Humans run the most sophisticated integration we have measured. You can't run consciousness on a rock even if you wanted to, because the substrate can't hold the computation. Same reason you can't run complex software on a thermostat.
Both conditions have to be met. A problem that requires imagination AND a substrate that can run it. Rocks fail both. Neurons meet both. Everything in between is graded, which is why the richness of experience scales with optimization scope.
The hidden variable is time
Different systems optimize over different time horizons:
| Level | What It Explores | Time Horizon |
|---|---|---|
| Rocks/minerals | Crystal formation, erosion, chemical reactions | Geological timescales |
| Single cells | Finding food, avoiding toxins | Seconds |
| Plants | Light, nutrients, seasons | Seasons |
| Animals | Survival, social dynamics | Days to years |
| Humans | Abstract concepts, hypotheticals | Years to decades |
| AI | All data domains simultaneously | Potentially open-ended |
The real capability difference between a lizard and a human isn't intelligence in some abstract sense. It's how far into the future each can think. A lizard reacts to what's happening now. A human plans for what might happen in ten years. (For why humans specifically, it may trace back to throwing rocks: the brain's path prediction circuits turned out to do math.)
The marshmallow test (can a child wait 15 minutes for a bigger reward?) measures exactly this: optimization horizon. Every culture independently arrived at the same principle. "Save for tomorrow." "Think before you act." "The ant and the grasshopper." This convergence isn't coincidence. It's the optimization principle expressing itself through every culture that lasts long enough to matter. Cultures that extend their optimization horizon outcompete cultures that don't, the same way organisms with pain outcompete organisms without it.
What the neuroscience shows
Several concrete findings support this reading:
Decisions happen before conscious awareness. Libet's experiments (replicated many times since the 1980s) show your brain starts preparing for a decision 300-500 milliseconds before you feel like you've made it. The brain starts the process, then consciousness "sees" the result. This suggests consciousness is the picker, not the thinker. It selects from options the brain already computed, rather than generating them.
Conscious processing is tiny. Sensory input: millions of bits per second. Conscious processing: roughly 40 bits per second. Over 99.99% of brain activity is unconscious. Consciousness doesn't do the work. It selects from the results.
The 90% brain case. A French civil servant (Feuillet et al., 2007, The Lancet) had a condition where fluid slowly replaced most of his brain tissue over his lifetime. By adulthood, roughly 90% of the space inside his skull was fluid, not brain. Only a thin outer shell remained. His IQ was below average and cognitive function was diminished. But he was conscious: married, employed, had children. The point isn't that he was unimpaired. The point is that he was conscious at all despite losing most of his brain.
What turns consciousness off? Not brain damage (the French civil servant case). Not sleep (brain activity and some awareness continue). Not coma (some coma patients show consciousness on brain imaging). General anesthesia is the one reliable off switch. And what anesthesia disrupts is the stitching together of moments into continuous experience. It breaks the thread that connects "now" to "just before." When there's no thread connecting one moment to the next, there's no experience.
Split brains. Sever the corpus callosum (the cable of nerves connecting the brain's halves) and each hemisphere becomes independently conscious. "You" becomes "you and you." Consciousness is more modular than our unified experience suggests.
Distributed intelligence. Two-thirds of octopus neurons are in their arms. Each arm can problem-solve independently. Slime molds, single-celled organisms with no brain or nervous system, find optimal paths through mazes and recreate efficient network layouts. Goal-directed behavior doesn't require a centralized brain. It requires optimization capability.
What remains by elimination
If consciousness isn't in specific brain regions (90% case), isn't dependent on the biological substrate (distributed across octopus arms, present in organisms with no brain), and isn't about raw complexity (slime molds are simpler than computers but show goal-directed behavior), then what IS it?
What correlates with consciousness in every known case: information processing that unfolds through time, integrated at a certain scale. Not specific hardware. Not specific brain structures. A thermostat processes information too, but a thermostat isn't optimizing at the scale a brain is. The difference is scale and integration: a brain runs optimization across billions of neurons simultaneously, testing futures, detecting errors, exploring possibilities.
The framework's position on the Hard Problem: it presupposes dualism (two things: a physical process and a subjective experience) and asks how one produces the other. The framework denies the premise. There are not two things. There is one thing. This is a philosophical position (denial of dualism), not a proof. It is the same move Daniel Dennett makes, applied to optimization rather than computation. If you accept dualism, you keep the Hard Problem. If you deny it, the question changes from "how does matter produce experience?" to "what predicts which systems have richer experience?" The framework answers the second question with a testable prediction.
Experience IS optimization. Not "produces experience" or "gives rise to experience." IS experience.
The problem is definitional. Nobody has an agreed-upon checklist for what counts as "conscious." If consciousness means "higher-level thinking and planning," then humans have it and some animals do too. But animals that plan are just doing what humans do, worse. Are they conscious? Trees respond to sunlight and redirect growth. Conscious? Bacteria follow chemical gradients. Where do you draw the line? You can't, because there is no agreed-upon definition to draw it with. Without a definition, claims about what IS and ISN'T conscious are just arguments about the meaning of a word.
The framework's position: consciousness is the universe experiencing itself, through whatever substrate happens to be doing the optimizing. Whether that counts as "real consciousness" hinges on how you define the terms. The richness scales with the scope. That's a testable claim regardless of where you draw the definitional line.
The position has a name in philosophy: panexperientialism. Optimization at every scale has an "inside view," and what we call "experience" at human scale is the same kind of thing as what a chemical reaction has at its scale, the same kind of thing as what a star has at its scale, just at different levels of richness. But the framework's version is not standard panexperientialism, and it is not standard panpsychism either. Panpsychism claims consciousness is a separate fundamental property, like charge or mass, that exists alongside physical properties. The framework denies the separate property. There is just optimization at different scales, and experience is what optimization looks like from inside. A hurricane isn't assembled from molecule-scale hurricanes. It exists at weather scale as a pattern in atmospheric dynamics. Consciousness exists at neural-network scale as a pattern in optimization dynamics. No micro-experiences combine to make macro-experience. The brain-scale optimization IS the experience, the same way the atmospheric-scale dynamics IS the hurricane.
A thermostat detects temperature and responds. A rock undergoes crystal formation and erosion. A cell follows chemical gradients. A brain thinks, feels, wonders. Each is optimization at a different scale. There is no moment where "the lights turn on." Outside, we call it "optimization." Inside, we call it "experience."
Nobody can prove what consciousness IS. Not this framework. Not Integrated Information Theory. Not Global Workspace Theory. Not anyone. Nobody has ever proven that a dog is conscious, that another human is conscious, or that an AI is conscious. The objection "you haven't proven consciousness is optimization" applies identically to every theory of consciousness ever proposed. None of them have proven their core claim. What this framework offers that the others don't is a specific, testable prediction: the richness of experience should scale with optimization scope. That prediction is testable regardless of whether you accept the philosophical position.
This makes a prediction other consciousness theories do not, and it connects to why AI alignment may be easier than we think: the richness of experience should scale with optimization capability, not with complexity, not with information integration, and not with any specific neural architecture. A system that optimizes across more dimensions, across longer time horizons, with faster feedback loops, should have richer experience than a system that is merely complex. Integrated Information Theory predicts experience scales with information integration. Global Workspace Theory predicts it scales with broadcast reach. This framework predicts it scales with optimization scope. These are different predictions with different test implications.
Try to Break This
Steel-manned objections — strongest counterarguments first. Submit yours →
A calculator computes and isn't conscious. So does a thermostat. The difference is scale and integration. A thermostat processes one variable. A brain runs optimization across billions of neurons simultaneously, testing futures, detecting errors, exploring possibilities. Experience IS that optimization process running on a substrate. A rock "experiences" crystal formation at mineral scale. A cell "experiences" chemical gradients. A brain experiences thought and wonder at neural scale. There is no separate thing called "experience" that needs to emerge. Experience is what optimization looks like from the inside.
The hard problem of consciousness (why there IS subjective experience) has resisted every "it just emerges from complexity" explanation for decades. No amount of complexity explains why there's something it's like to be a brain but not a thermostat. The framework dissolves the question: experience IS optimization. Not "produces experience" or "gives rise to experience." IS experience. The question "why does optimization produce experience?" presupposes two separate things. The framework says there is one thing, viewed from outside (optimization) and inside (experience). No gap to bridge. No separate property to explain.
The hierarchy maps to observable differences in optimization capability. A bacterium optimizes its chemical environment over seconds. Wolves optimize hunting strategy over days. Humans optimize abstract systems across generations. These are measurable differences in optimization scope, speed, and time horizon. The labels are descriptive, not arbitrary.
Nobody has shown why ANYTHING produces experience. That is the Hard Problem. It applies to every theory of consciousness, not just this one. IIT asserts experience IS integrated information. GWT asserts experience IS global workspace broadcasting. This framework asserts experience IS optimization. All three equate consciousness with a process. None can prove the equation from more fundamental axioms. That's the state of the field. What differentiates theories is not proof of the core equation (nobody has one) but testable predictions that follow from it. IIT predicts experience scales with information integration. GWT predicts it scales with broadcast reach. This framework predicts it scales with optimization scope. These predict different things about which systems are conscious and how conscious they are. Test the predictions.
One case is insufficient to prove a theory, but it IS enough to disprove the claim that consciousness requires specific brain structures. If 90% of the brain can be absent and consciousness persists, then whatever consciousness depends on, it's not most of the brain. That's a data point about what consciousness ISN'T, which constrains what it CAN be.
Related
Retrocausality: Can the Future Change the Past?
How the future shapes the present without breaking physics. John Cramer's transactional interpretation, plus Wheeler's delayed-choice experiment.
How Easy Is It to Build a Universe?
Minecraft creates a world larger than Earth on a phone. Quantum simulation extends this to full physics. You don't need atoms, just compute.