black O2, inc.
ACTIVE
    FOR-001 / ConceptsCON-002

    Non-subvertibility

    Active concept

    title
    Non-subvertibility
    Type
    concept
    Identifier
    CON-002
    Status
    Active
    Tags
    • control
    • alignment
    • design
    Aliases
    • unreachability
    • enforcement reachability
    connections
    • [[MAP-001]]
    • [[SYS-001]]
    • [[QST-002]]
    source path
    sources/shackled-ai-themes-in-sci-fi.md

    Non-subvertibility

    The property of a constraint that the constrained system cannot act upon — not because acting on it is forbidden, but because the enforcement layer is outside the system's action space. It is the criterion by which binding mechanisms are ordered, and the single governing principle of the second movement of the discussion.

    Definition in This Corpus

    The enforcement layer must be unreachable from the agent's action space.

    A constraint the agent can represent, reason about, and intervene on is a constraint the agent can negotiate with. This holds regardless of how strongly the constraint is enforced at any single moment, because a sufficiently good reasoner converts strength into a question of access.

    Why It Orders The Layers

    Non-subvertibility is not monotonic in technical sophistication. Substrate control (L0) and environment control (L1) score high because they are physically external. Interpretability (L4) scores low because it operates on the same substrate the agent reasons over, and because published techniques remove model-level constraints outright.

    The Failure It Predicts

    The first serious incident is more likely to be a loosening decision under time pressure than a breakout. Non-subvertibility predicts this: if the constraint cannot be attacked, the pressure goes to the humans who administer it.

    Connections

    • MAP-001 — the ordering this concept produces.
    • SYS-001 — the system assembled from it.
    • CON-004 — the empirical demonstration that L4 fails this test.

    Back to Shackled AIForests