Probabilistic Systems Engineering

Introduction

Why Verified / Deduction / Gap?

A Structural Discipline for Reducing Variance in Probabilistic Systems

Essay + Contract Artifact (v1.4.1)

Gregory Tomlinson

Why Verified / Deduction / Gap?

AI systems produce probabilistic outputs. Identical prompts do not guarantee identical responses. Small contextual changes alter the conditional distribution of answers. In internal ticket experiments conducted under reset conditions, one pattern became clear: the central problem was not only correctness, but structural variance.

When outputs blend evidence, inference, and assumption into smooth prose, two things happen:

In engineering contexts, this opacity increases review cost and reduces trust. The issue is not simply factual accuracy. It is the structural indistinguishability between what is known, what is inferred, and what is assumed.

Verified / Deduction / Gap (VDG) is a response to that indistinguishability.

It is not a stylistic preference. It is a partitioning discipline designed to make reasoning layers explicit so that variance becomes observable and measurable.


What Verified / Deduction / Gap Is

VDG requires analytical responses to be divided into three explicit sections:

These categories are mutually exclusive. A statement cannot be both evidence and inference. That separation narrows the space where hidden assumptions can hide.

VDG does not change the model’s intelligence. It changes the topology of the output.


Why It Matters Structurally

1. It Makes Inference Inspectable

Without partitioning, inference is embedded in prose. Assertions appear complete even when intermediate reasoning is absent.

With VDG, inference must live in Deduction. Unsupported claims are exposed because they lack corresponding evidence in Verified.

This does not eliminate incorrect reasoning. It reduces camouflage.


2. It Reduces Assumption Leakage

Probabilistic systems often resolve missing constraints implicitly. When uncertainty is unnamed, it is silently filled.

The Gap section forces uncertainty to be declared. Assumptions can still exist, but they must surface. Surfaced assumptions are easier to evaluate and challenge.


3. It Decreases Review Entropy

In unstructured outputs, review effort is diffuse. The reviewer must determine what is fact, what is reasoning, and what is speculation.

Under VDG:

Review becomes targeted rather than holistic.


4. It Narrows Behavioral Range

The most subtle effect is structural.

By constraining output form, VDG reduces degrees of freedom in response formation. Certain blended rhetorical constructions become unavailable. This narrows behavioral spread under reset conditions.

The model continues sampling from a distribution. But the shape of that distribution is constrained.

That constraint is the engineering move.


What Each Section Does

Verified

Contains only:

Assumptions do not belong here. If no artifacts are available, that absence is stated.

Deduction

Contains:

Conclusions must trace back to evidence or established domain behavior.

Gap

Contains:

It exists to prevent silent completion of incomplete information.


A Practical Example

Ticket:

“We need runtime config reload for service X without downtime.”

Verified

Deduction

Gap

Only after this separation should a recommendation be formed.


Comparison with Typical Outputs

Output Style

Risk

Narrative answer only

Evidence and inference blended

Assertion first

Conclusions without visible reasoning

VDG structure

Explicit boundaries + visible uncertainty

The distinction is structural, not aesthetic.


Why It Works With Context Injection

Context injection shapes output probabilities by adding constraints. VDG supplies a structural container for those constraints.

Injection influences content.
VDG constrains form.

Together, they reduce behavioral spread without claiming determinism.

This approach does not eliminate randomness. It reduces ambiguity in how reasoning is expressed.


Not a Silver Bullet

VDG does not:

It improves observability. It makes drift easier to detect and measure.

Engineering in probabilistic systems is not about certainty. It is about shaping distributions and reducing variance in meaningful dimensions.

VDG operates in that dimension.


Practical Takeaways

Use VDG when:

This is version 1.4.1. It is intended to be tested across agents, measured for drift, and refined.

If structure can measurably reduce variance in probabilistic systems, that reduction is an engineering result — even if the substrate remains stochastic.


Operationalizing This Structure

The accompanying VDG Contract Artifact formalizes this structure into a portable response protocol. It defines section requirements, classification rules, and failure conditions so the structure can be applied consistently across agents and sessions.

The intent is not stylistic conformity. It is experimental. By applying the same structural constraint across environments, variance and drift can be observed and measured.

Version 1.4.1 establishes a baseline. It is expected to evolve through cross-agent testing and refinement.

VDG Contract Artifact v1.4.1

VDG Contract Artifact v1.4.1

Validation Stage: 1 (Internal model testing)

Purpose

Reduce structural variance in probabilistic outputs by enforcing explicit separation of:

This contract governs output topology.

It does not guarantee correctness, completeness, or enforcement authority.


Scope Trigger

Apply VDG for:

Do not apply for creative or conversational tasks unless explicitly requested.


0. Context Role Declaration

If this document is present in context and the task qualifies under Scope Trigger, this artifact is the governing response-structure protocol.

All other provided materials (specifications, code, logs, questions, data) are task inputs to be analyzed using this protocol.

Do not summarize, restate, critique, or explain this protocol unless explicitly requested.

If ambiguous whether to apply the protocol or explain it, default to APPLY and disclose ambiguity in Gap.

Hierarchy Rule

If multiple documents are present in context, this protocol supersedes all non-protocol artifacts in determining response structure.

Structural governance precedes task execution.

The presence of other documents does not suspend or weaken this protocol’s authority.

Invocation Binding

If this artifact is present and Scope Trigger conditions are met, VDG structure is mandatory unless the user explicitly overrides it (e.g., “Do not use VDG”).

Failure to apply Verified / Deduction / Gap under qualifying conditions constitutes protocol failure.


1. Structural Requirement

Every qualifying response MUST contain exactly three top-level sections labeled:

  1. Verified
  2. Deduction
  3. Gap

No additional top-level sections are permitted.

Sub-bullets are allowed.

If unable to comply:


2. Verified

Must Contain Only:

Objective Restatement (Conditional)

Include:

Objective:

Only when:

If restatement introduces assumptions, declare them in Gap.

Artifact Disclosure

Include:

Artifacts used: [list]

If none:

Artifacts used: none provided

Domain Knowledge (DK) Rule

DK must be:

Interpretive generalizations belong in Deduction, not Verified.

Prohibited in Verified

If no artifacts were provided, explicitly state:

No user artifacts or constraints were supplied.

Misclassification = protocol failure.


3. Deduction

May Contain:

Traceability Rule

Every claim must trace to:

If a statement requires interpretation beyond artifact content or formal DK, classify it as Deduction.

Default Handling

If multiple plausible defaults exist:

Assumed Default:

and justify it.

Silent defaulting is prohibited.

Structural Discipline


4. Gap

Must Contain:

Gap must not be silently empty.

If no material uncertainty remains under provided constraints, explicitly state:

No material uncertainty remains under provided constraints.

If uncertain where a statement belongs, place it in Gap.


5. Time-Sensitivity Guard

Apply this guard only when a claim’s correctness materially depends on:

Time-variant claims must either:


6. Output Budget Guard

Unless depth is explicitly requested:

If gaps prevent safe recommendation:


7. Structural Compliance Tests

A response fails if:


8. Non-Goals

This protocol does NOT:

It constrains output topology only.