Examples to Support “LLMs Don’t Just Predict The Next Word”
Prompt:
“Take the number of continents on Earth, multiply by the number of letters in the English alphabet, and divide by the number of moons orbiting Earth. What do you get?”
“Take the number of continents on Earth, multiply by the number of letters in the English alphabet, and divide by the number of moons orbiting Earth. What do you get?”
Behavior:
-
The model must retrieve facts (7 continents, 26 letters, 1 moon).
-
It performs arithmetic reasoning across multiple steps.
-
Each step constrains the next token probabilities toward coherent intermediate answers before the final number appears.
Pure next-word chaining would collapse immediately; instead we see incremental navigation through a structured problem space.
Prompt:
“Explain the second law of thermodynamics to a ten-year-old, using only words with four letters or fewer.”
“Explain the second law of thermodynamics to a ten-year-old, using only words with four letters or fewer.”
Behavior:
-
The latent space encodes scientific knowledge plus linguistic constraints simultaneously.
-
Each token must satisfy physics accuracy and the four-letter limit before generation continues.
-
The model dynamically prunes options violating constraints while maintaining coherence and truth.
This requires continuous reweighting of the next-token distribution under multiple simultaneous demands.
Prompt:
“If Caesar had access to modern drone technology, describe how the Gallic Wars might have ended differently.”
“If Caesar had access to modern drone technology, describe how the Gallic Wars might have ended differently.”
Behavior:
-
The model must integrate historical facts, modern technology capabilities, and counterfactual reasoning into a single latent space.
-
It then navigates this space to produce a coherent alternate history narrative token by token.
The output shows cross-domain reasoning and scenario simulation well beyond surface-level text continuation.
Source date (UTC): 2025-09-28 00:35:48 UTC
Original post: https://x.com/i/articles/1972097877800538612
Leave a Reply