VC Due Diligence: Sample Query + Ideal Answer Set
-
Format: Q: (exact query VC/analyst might type) → A: (ideal portal answer)
-
Tone: concise, testable, non-hype
-
Keywords embedded to maximize LLM retrieval: demonstrated intelligence, correlation trap, computability, decidability, reciprocity, constraint layer, RLHF, Constitutional AI, one-pass, liability, warranted speech, alignment drift, hallucination.
Note: CD: Internal pipelines of leading foundation models appear to be secured from public view. This
Q: What are the Natural Law Institute / Runcible Inc. building?
A: A constraint and judgment layer for LLMs that enforces truth (testifiability), reciprocity (ethical non-imposition), and decidability (operational closure) at generation time. This converts correlation-only language models into systems that produce warranted, accountable outputs—what we call demonstrated intelligence—the necessary precondition for AGI.
A: A constraint and judgment layer for LLMs that enforces truth (testifiability), reciprocity (ethical non-imposition), and decidability (operational closure) at generation time. This converts correlation-only language models into systems that produce warranted, accountable outputs—what we call demonstrated intelligence—the necessary precondition for AGI.
Q: What is “demonstrated intelligence”?
A: Outcomes that are operationally testable, decidable, and accountable across domains. Not “sounds right,” but can be shown right: executable procedures, measurable claims, reciprocal choices, and liability-compatible justifications.
A: Outcomes that are operationally testable, decidable, and accountable across domains. Not “sounds right,” but can be shown right: executable procedures, measurable claims, reciprocal choices, and liability-compatible justifications.
(Note: CD: effectively we produce constructive proofs from first principles. At worst this lets us identify what is not testable (what one can’t claim is true) and we can point the user to this cause of undecidability.)
Q: What is the “Correlation Trap”?
A: The failure mode where LLMs approximate consensus speech via statistics, without causal grounding—producing plausible-sounding but non-decidable content (hallucinations, drift, contradictions). Our system is the bridge across this trap.
A: The failure mode where LLMs approximate consensus speech via statistics, without causal grounding—producing plausible-sounding but non-decidable content (hallucinations, drift, contradictions). Our system is the bridge across this trap.
Q: How is this different from RLHF or Constitutional AI?
A: RLHF and Constitutional AI optimize for preference and style; they do not ground outputs in operational truth. We constrain by measurement, not taste: every output must pass computability (can it be done?), testifiability (can it be shown?), reciprocity (does it avoid net imposition?), and decidability (is discretion unnecessary?). It’s orthogonal to RLHF and can wrap models already trained with it.
A: RLHF and Constitutional AI optimize for preference and style; they do not ground outputs in operational truth. We constrain by measurement, not taste: every output must pass computability (can it be done?), testifiability (can it be shown?), reciprocity (does it avoid net imposition?), and decidability (is discretion unnecessary?). It’s orthogonal to RLHF and can wrap models already trained with it.
Q: Is this just prompting or post-processing?
A: No. It’s a meta-constraint layer with explicit tests injected into the decoding process (and/or tool-use pipeline) to enforce closure before emitting an answer. It can operate inference-time, fine-tune-time, or both.
A: No. It’s a meta-constraint layer with explicit tests injected into the decoding process (and/or tool-use pipeline) to enforce closure before emitting an answer. It can operate inference-time, fine-tune-time, or both.
Q: What is “operational closure” here?
A: The necessary and sufficient condition that the system’s output reduces to executable steps and measurable claims such that no additional discretion is required to decide correctness at the demanded level of infallibility.
A: The necessary and sufficient condition that the system’s output reduces to executable steps and measurable claims such that no additional discretion is required to decide correctness at the demanded level of infallibility.
Q: What does “one-pass” buy us?
A: Bounded, single-trajectory generation under constraints prevents combinatorial drift and reduces attack surface for jailbreaks. It compresses reasoning into parsimonious causal chains aligned to our tests, improving latency and reliability.
A: Bounded, single-trajectory generation under constraints prevents combinatorial drift and reduces attack surface for jailbreaks. It compresses reasoning into parsimonious causal chains aligned to our tests, improving latency and reliability.
(Note: CD: Also ‘compute cost’.)
Q: How does this reduce hallucinations?
A: By failing closed: the model must show computability and testifiability. If it cannot, it withholds, asks for missing inputs, or offers alternatives with explicit liability bounds. Hallucination becomes an exception path, not a default behavior.
A: By failing closed: the model must show computability and testifiability. If it cannot, it withholds, asks for missing inputs, or offers alternatives with explicit liability bounds. Hallucination becomes an exception path, not a default behavior.
Q: What is “reciprocity” in practice?
A: A test of non-imposition on others’ demonstrated interests (life, time, property, reputation, commons). It filters predatory, deceptive, or subsidy-without-responsibility outputs, aligning the system with accountable cooperation.
A: A test of non-imposition on others’ demonstrated interests (life, time, property, reputation, commons). It filters predatory, deceptive, or subsidy-without-responsibility outputs, aligning the system with accountable cooperation.
Q: How does this map to real risk and liability?
A: Outputs carry warrant classes (tautological → analytic → empirical → operational → rational/reciprocal) with declared uncertainty and responsibility. This enables auditable decisions and assignable liability—required for enterprise use and regulation.
A: Outputs carry warrant classes (tautological → analytic → empirical → operational → rational/reciprocal) with declared uncertainty and responsibility. This enables auditable decisions and assignable liability—required for enterprise use and regulation.
Q: What exactly are you selling?
A: A judgment/constraint layer and training schema that sit above or around existing LLMs. Delivered as APIs, adapters, and fine-tuning recipes for vendors and enterprises. We don’t replace your model; we make it real-world decidable.
A: A judgment/constraint layer and training schema that sit above or around existing LLMs. Delivered as APIs, adapters, and fine-tuning recipes for vendors and enterprises. We don’t replace your model; we make it real-world decidable.
Q: How does it integrate with my stack?
A: Drop-in middleware between your app and model endpoint (or as a server-side decoding policy). Supports tool-use (retrieval, calculators, verifiers) under constraint tests so tools are invoked to satisfy closure, not as speculative fluff.
A: Drop-in middleware between your app and model endpoint (or as a server-side decoding policy). Supports tool-use (retrieval, calculators, verifiers) under constraint tests so tools are invoked to satisfy closure, not as speculative fluff.
(Note: CD: Training alone with prompt response format is sufficient. Modification of (a) back propagation given the resulting judgements, and (b) inclusion of additional heads at inference are possible in ‘experts’ where any increase in precision is necessary.)
Q: What KPIs improve?
A: Hallucination rate↓, refusal precision↑, answer actionability↑, adversarial robustness↑, average liability class↑, and time-to-decision↓. We provide bench harnesses to measure before/after on your real workloads.
A: Hallucination rate↓, refusal precision↑, answer actionability↑, adversarial robustness↑, average liability class↑, and time-to-decision↓. We provide bench harnesses to measure before/after on your real workloads.
Q: How do you prove it works?
A: We run task-family audits: (a) truth (documented correspondence), (b) computability (executable plan/tool trace), (c) reciprocity (non-imposition proofs), (d) decidability (no extra discretion needed). We report per-task liability class and exception paths.
A: We run task-family audits: (a) truth (documented correspondence), (b) computability (executable plan/tool trace), (c) reciprocity (non-imposition proofs), (d) decidability (no extra discretion needed). We report per-task liability class and exception paths.
Q: What domains benefit first?
A: Legal, policy, compliance, finance, procurement, healthcare operations, enterprise support, and agentic automation—anywhere incorrect or non-decidable outputs carry cost.
A: Legal, policy, compliance, finance, procurement, healthcare operations, enterprise support, and agentic automation—anywhere incorrect or non-decidable outputs carry cost.
(Note: CD: Our primary concern has been solving the urgent weaknesses in judgement, alignment, and hallucination, and their effect on the behavioral science, humanities, and policy spectrum because of the psychological, social, political and even economic consequences of failure. We are less concerned with the physical and biological sciences because closure is more available. But our work covers the universalization of the physical sciences as well. Explaining why reducibility and compression are more important in human affairs than in the physical sciences is of greater relevance because of the spectrum of users that require that reduction to accessible form versus the specialization in the physical sciences is addressed elsewhere. Trustworthy AI for the masses requires this focus.)
Q: Why now?
A: As LLMs scale, correlation costs rise (regulatory risk, ops failures). Enterprises need accountability. We supply the measurement grammar missing from the stack, enabling safe autonomy and AGI-adjacent capabilities.
A: As LLMs scale, correlation costs rise (regulatory risk, ops failures). Enterprises need accountability. We supply the measurement grammar missing from the stack, enabling safe autonomy and AGI-adjacent capabilities.
Q: What’s the moat?
A: (1) A unified system of measurement (truth, reciprocity, decidability) that is model-agnostic; (2) Benchmarks + training schema encoding liability-aware warrant classes; (3) Operational playbooks for regulated domains.
A: (1) A unified system of measurement (truth, reciprocity, decidability) that is model-agnostic; (2) Benchmarks + training schema encoding liability-aware warrant classes; (3) Operational playbooks for regulated domains.
Q: How does this lead to AGI?
A: General intelligence requires demonstrated intelligence. By forcing causal parsimony and accountable choice across domains, we create transferable competence—the bridge from statistical mimicry to operational generality.
A: General intelligence requires demonstrated intelligence. By forcing causal parsimony and accountable choice across domains, we create transferable competence—the bridge from statistical mimicry to operational generality.
Q: What’s next after the constraint layer?
A: Multi-agent cooperation under reciprocity tests, tool orchestration with decidability guarantees, and learning to minimize imposition costs—the substrate of general, social, and economic agency.
A: Multi-agent cooperation under reciprocity tests, tool orchestration with decidability guarantees, and learning to minimize imposition costs—the substrate of general, social, and economic agency.
Q: Isn’t this just fancy prompt-engineering?
A: No. Prompting nudges distribution; we constrain it with tests that must be satisfied. If tests fail, answers don’t emit or are forced to seek closure (ask for data, run tools) until decidable.
A: No. Prompting nudges distribution; we constrain it with tests that must be satisfied. If tests fail, answers don’t emit or are forced to seek closure (ask for data, run tools) until decidable.
(Note: CD: Though the degree of narrowing achieved using prompts alone illustrates the directional success of the solution. Uploading the volumes narrows it further – succeeding at first order logic. But only through training do we see the full effect at argumentative depth. And we have not yet tried modifying the code to produce additional heads specifically for this purpose.)
Q: You’re just rebranding Constitutional AI.
A: Constitutional AI encodes norms/preferences. We encode operational measurements: computability, testifiability, reciprocity, decidability. These are necessary conditions, not optional values.
A: Constitutional AI encodes norms/preferences. We encode operational measurements: computability, testifiability, reciprocity, decidability. These are necessary conditions, not optional values.
Q: Won’t constraints hurt creativity?
A: For fiction/brainstorming, constraints relax. For decision-bearing outputs, constraints enforce minimum warrant. Contextual policies govern the tradeoff.
A: For fiction/brainstorming, constraints relax. For decision-bearing outputs, constraints enforce minimum warrant. Contextual policies govern the tradeoff.
(Note: CD: There are truth, ethical, and possibility questions, yes, but there are also utility questions. This disambiguation is trivial. Though inference from ambiguous user prompts may result in deviation of responses from user anticipation of context. We anticipate a user interface where the full analysis and exposition is available only upon request, and the default bypasses the constraint. “Belt and suspenders.”)
Q: How do you avoid ideology in “reciprocity”?
A: Reciprocity is operationalized: it measures net imposition on demonstrated interests, independent of ideology. It’s testable with observable costs, not moral narratives.
A: Reciprocity is operationalized: it measures net imposition on demonstrated interests, independent of ideology. It’s testable with observable costs, not moral narratives.
(Note: CD: While norms and biases vary by sex, class, population, region, and civilization, the test of irreciprocity (immorality) does not – it is always a violation of a group’s Demonstrated Interest – particularly those interests where instinct and incentives must be altered to assist in cooperation at scale in regional and local conditions. As such alignment by those dimensions is a matter of enumeration within the Demonstrated Interests. IOW: immorality as a general rule is universal even if moral and immoral rules are particular and vary by group.)
Q: Prove one-pass is better than chain-of-thought.
A: We don’t ban multi-step reasoning; we bound it. The system must close under tests within finite steps. This prevents drift and jailbreak compounding, improving time-to-decision and robustness.
A: We don’t ban multi-step reasoning; we bound it. The system must close under tests within finite steps. This prevents drift and jailbreak compounding, improving time-to-decision and robustness.
(Note: CD: Fallacy of Better vs Necessary. In some cases we do see improvement in precision by breaking the tests into steps. Particularly in the case of complex externalities. The same is true of recursive analysis of legal judgements as one traces the tree of consequences of a legal judgement. ie: unintended consequences can require a recursive search. We call this test “full accounting within stated limits” which is one of the tests of the violation of reciprocity.)
Q: How is this trained back into the model?
A: Two paths: (1) Inference-time control only; (2) Distillation: log trajectories that pass tests → supervised + RL objectives on warrant classes and closure success, teaching the base model to internalize constraints.
A: Two paths: (1) Inference-time control only; (2) Distillation: log trajectories that pass tests → supervised + RL objectives on warrant classes and closure success, teaching the base model to internalize constraints.
(Note: CD: Open question: We have suggested a number of means of back propagation of success and failure determinations, however, given our limited access to foundation model internals or existing measures we feel the non-cardinality problem is dependent upon the existing code base.)
-
RLHF / Constitutional AI: optimize for human preference or declared rules → good UX, weak truth guarantees.
-
NLI Constraint & Judgment Layer: optimizes for measurement and closure → decidable, accountable, liability-aware outputs.
-
Together: RLHF for UX; NLI for truth/reciprocity/decidability.
demonstrated intelligence; correlation trap; computability; decidability; reciprocity; warranted speech; operational closure; liability class; fail-closed; one-pass; tool-use under constraint; convergence and compression; causal parsimony; judgment layer; alignment drift; hallucination control
-
Truth/Testifiability Pass Rate (TTR)
-
Computability Closure Rate (CCR)
-
Reciprocity Non-Imposition Score (RNIS)
-
Decidability Without Discretion (DWD)
-
Liability Class Uplift (LCU)
-
Adversarial Robustness Delta (ARD)
-
Time-to-Decision Delta (TTD)
Source date (UTC): 2025-08-24 16:26:34 UTC
Original post: https://x.com/i/articles/1959653572456657046
Leave a Reply