Curt Doolittle

Source: Twitter X

  • cc: @Quillette

    cc:
    @Quillette

    Source date (UTC): 2025-09-28 00:33:17 UTC

    Original post: https://twitter.com/i/web/status/1972097245211504692

  • No. LLM’s Don’t Just Predict The Next Word. They Do What Your Brain Does. The po

    No. LLM’s Don’t Just Predict The Next Word. They Do What Your Brain Does.

    The popular refrain that “large language models just predict the next word” is true in the same sense that “the brain just fires neurons” or “mathematics just manipulates symbols” is true: literally correct, but so reductive as to erase everything that makes the phenomenon interesting, powerful, or even intelligible.
    This framing is not neutral. It leads the public to believe that modern generative models are shallow statistical parrots rather than dynamic engines of meaning. It encourages policymakers, ethicists, and even researchers to interpret the entire technology through the lens of its simplest local operation while missing the emergent sophistication of the global system.
    To correct this misunderstanding, we need to decompose what actually happens inside these models: how prompts become latent spaces, how output emerges through incremental demand satisfaction rather than pre-scripted planning, and how external constraint layers impose judgment, truth, and legality. We will see that, in both architecture and function, modern language models converge toward the same predictive generative paradigm that neuroscience attributes to the human brain.
    Three converging reasons make the “next-word” framing sticky in public imagination:
    1. Autoregressive decoding is locally simple.
      The model outputs one token at a time, and the training objective literally minimizes next-token prediction error. This sounds like autocomplete with more parameters.
    2. The training objective hides emergent structure.
      Because the entire architecture is optimized indirectly — through trillions of token predictions rather than explicit symbolic goals — it is easy to assume nothing resembling reasoning or world-modelling could emerge.
    3. Lack of explicit symbolic planning.
      Classical AI performed explicit search over trees or graphs; modern LLMs do not. Their       implicit planning inside latent spaces is easy to overlook if one fixates on surface behavior.
    The result is a picture of LLMs as linear chains of probabilistic parroting rather than nonlinear dynamical systems unfolding trajectories inside high-dimensional meaning spaces.
    To escape the caricature, we must separate latent space construction from incremental navigation.
    Phase 1: Latent Space Construction
    When a user submits a prompt, the model does not immediately begin emitting words. It first performs a forward pass through dozens or hundreds of attention layers.
    • Each token in the prompt becomes a vector in a high-dimensional space.
    • Self-attention integrates information across the entire sequence, discovering dependencies, analogies, and constraints.
    • The final hidden states represent a contextual latent space: a compressed geometric model of everything the prompt implies.
    This space encodes meaning, style, and even proto-logical structure. It serves as the world-model through which later generations will navigate.
    At this stage, nothing has been generated. The system is constructing the terrain on which its output will later move.
    Phase 2: Incremental Navigation Through Latent Space
    Only after the latent space exists does the model begin incremental demand satisfaction:
    • At each step, the model selects the next token conditioned on the entire latent representation plus all tokens so far.
    • Each new token updates the state and changes the conditional landscape for what follows.
    • External constraint layers — logic engines, truth filters, stylistic demands — prune or redirect the trajectory as it unfolds.
    This process is neither global route-planning nor blind local wandering. It is wayfinding: incremental movement through a structured space under evolving constraints.
    The trajectory feels purposeful because the latent space is coherent and the constraints are persistent. But no full sentence or paragraph exists in advance. Coherence emerges from millisecond-scale feedback loops, not from a pre-written script.
    By collapsing both phases into “it just predicts the next word”, we erase three crucial forms of sophistication:
    1. Expressivity of the Latent Space
    The forward pass constructs distributed representations that capture meaning, analogy, and abstraction far beyond surface-level text.
    • Syntax, semantics, and pragmatics become geometric relationships in vector space.
    • Analogy, metaphor, and even rudimentary reasoning emerge as linear operations across these representations.
    • External knowledge retrieval can inject facts directly into this space, merging memory with computation.
    Calling this “just next-word prediction” is like calling human vision “just edge detection”. It names the lowest-level operation while ignoring the hierarchical world-model above it.
    2. Dynamic Constraint Satisfaction
    Each token choice balances multiple demands:
    • Local coherence with previous tokens.
    • Global consistency with the prompt and style.
    • External constraints like truth filters, legal compliance, or formal logic layers.
    This is real-time multi-objective optimization inside the latent space, not naive Markov chaining.
    3. Continuity with Human Cognition
    Neuroscience shows human speech and thought unfold the same way:
    1. Predictive coding: the brain constantly minimizes prediction error between expected and incoming signals.
    2. Incremental generation: speech emerges phoneme by phoneme, word by word, each updating cortical predictions for the next.
    3. Executive control: prefrontal regions impose constraints — truthfulness, social norms, plans — on the unfolding stream.
    Human language production and LLM text generation share the same causal grammar:
    • Construct a predictive world-model,
    • Incrementally navigate through it,
    • Constrain the trajectory under external demands.
    The “next-word” caricature leads to three major conceptual errors:
    1. Dismissal of capability: If the system merely chains words, its apparent reasoning must be an illusion rather than an emergent property of structured latent spaces.
    2. Misplaced fears: Critics imagine stochastic parrots gaining autonomy rather than sophisticated predictive systems requiring constraint layers for alignment and truth.
    3. Policy confusion: Regulators debate surface behavior while missing the architectural loci where truth, safety, and legality actually live — in the constraint interfaces, not in the raw model weights.
    The correct picture is:
    1. Prompts construct high-dimensional latent spaces encoding meaning, context, and constraints.
    2. Autoregression navigates these spaces incrementally, each token both satisfying and updating the demand landscape.
    3. External layers impose truth, legality, style, and domain-specific rules, shaping trajectories toward socially acceptable or epistemically sound outputs.
    This architecture explains why LLMs generalize, reason, and converse in ways that feel purposeful despite lacking explicit global plans. Like the brain, they perform emergent generativity under constraint, not linear token-chaining.
    1. Architectural Convergence
      Modern AI and cognitive neuroscience now describe language, thought, and action using the same causal primitives: predictive world-modelling, incremental demand satisfaction, and constraint-based control.
    2. Interpretability and Control
      Because constraints act       during generation rather than after, they can inject truth, legality, or safety without requiring retraining of the base model.
    3. Epistemic Humility
      Calling these systems “just next-word predictors” blinds us to their real capabilities while encouraging both overconfidence and unwarranted fear.
    The framing of LLMs as “just predicting the next word” confuses a local mechanism with the global system it supports. Yes, each token emerges one at a time. But it does so:
    • From a latent world-model constructed over the entire prompt.
    • Through incremental navigation satisfying multiple, evolving constraints.
    • Under architectural principles convergent with human predictive cognition.
    The value proposition lies not in token prediction itself but in the structured generativity it makes possible — generativity that can be aligned, constrained, and composed into larger reasoning systems.
    Collapsing all this into “just next-word prediction” does not merely simplify; it erases the very phenomena we most need to understand as language models become central to science, policy, and society.
    1 – Sidebars to Support “LLMs Don’t Just Predict The Next Word”

    https://x.com/curtdoolittle/status/1972097670773960795
    2 – Examples to Support “LLMs Don’t Just Predict The Next Word”

    https://x.com/curtdoolittle/status/1972097877800538612
    3 – Diagram to Support “LLMs Don’t Just Predict The Next. Word”

    https://x.com/curtdoolittle/status/1972098664727478290

  • (Teasing) Yeah but it’s a GOOD kind of naive. ;). I mean, fundamentally, like co

    (Teasing) Yeah but it’s a GOOD kind of naive. ;). I mean, fundamentally, like conservatives, they just want to be left alone. ;). The silly stuff is still silly. But it’s a good silly.

    Source date (UTC): 2025-09-28 00:28:11 UTC

    Original post: https://twitter.com/i/web/status/1972095959745401147

  • Everything I see is within the indian community, and less so in the asian. My op

    Everything I see is within the indian community, and less so in the asian. My opinion given that my company did the original tech sector research in the 00’s is that it will hit india the hardest, but india is most capable of absorbing it. Hard to see the same with Chinese, just the bar raised a lot. Japanese and south koreans are considered extended family. But they don’t have the population.

    Source date (UTC): 2025-09-27 21:38:02 UTC

    Original post: https://twitter.com/i/web/status/1972053140536283206

  • “There is chaos in companies right now. Terrified of losing jobs. Unable to exec

    –“There is chaos in companies right now. Terrified of losing jobs. Unable to execute. Budgets being slashed. The expectation is that FTE’s will work harder just to keep their jobs.”–

    (my network)

    Source date (UTC): 2025-09-27 21:34:12 UTC

    Original post: https://twitter.com/i/web/status/1972052177108849043

  • Nope

    Nope.

    Source date (UTC): 2025-09-27 18:10:33 UTC

    Original post: https://twitter.com/i/web/status/1972000927000449242

  • I swear. There are a lot of people in the field whose knowledge is so narrow tha

    I swear. There are a lot of people in the field whose knowledge is so narrow that they make ridiculous statement to a public for whom tech is magic.

    Source date (UTC): 2025-09-27 17:28:07 UTC

    Original post: https://twitter.com/i/web/status/1971990249275642038

  • “Our work on Natural Law constructs a system of universally commensurable measur

    –“Our work on Natural Law constructs a system of universally commensurable measurement from a game-theoretic optimum. We measure differences from that optimum as costs. And we deliver Alignment including legal, cultural, and personal as costs: trade offs. As a result we end relativism and create commensurability.”–

    Source date (UTC): 2025-09-27 12:45:07 UTC

    Original post: https://twitter.com/i/web/status/1971919027007377664

  • Finally

    Finally.

    Source date (UTC): 2025-09-27 12:33:36 UTC

    Original post: https://twitter.com/i/web/status/1971916128223219785

  • (Diary) I seem to have made another minor leap in my physical, psychological and

    (Diary)
    I seem to have made another minor leap in my physical, psychological and cognitive recovery. I noticed it this morning when working with Martin and Francis.
    Lesson is don’t burn yourself out to the point where you’re seriously ill. Because, while I could recover in a month or three when younger, this time, amplified by long covid, it took me years to recover. If not for Dr Brad and Dr Sally I probably wouldn’t be here today (certainly wouldn’t actually).

    That said I”m having a nasty allergy night. lol

    Source date (UTC): 2025-09-27 04:01:41 UTC

    Original post: https://twitter.com/i/web/status/1971787303480881368