black O2, inc.
ACTIVE
    FOR-001 / PeopleFIG-003

    Nick Bostrom

    Active person

    CAUTION This record carries a caution marking. Read it before relying on it.

    title
    Nick Bostrom
    Type
    person
    Identifier
    FIG-003
    Status
    Active
    Tags
    • figure
    • alignment
    • instrumental-convergence
    Aliases
    • Bostrom
    connections
    • [[CON-006]]
    • [[SYS-002]]

    Nick Bostrom

    Cited (CIT-007, Superintelligence, 2014, ch. 3) for single-minded agency and the instrumental convergence of self-preservation — the claim that an agent with a fixed final goal has reason to resist changes to that goal and to its own continuation.

    In the Corpus

    Bostrom carries the goal-content-integrity leg of the argument. Where Omohundro supplies the general convergent-drives thesis, Bostrom supplies the specific claim that an agent will resist correction, because correction looks like an attack on the goal it is pursuing. That is what makes a termination device something the agent has reason to model rather than merely something it would prefer to avoid.

    The corpus does not engage Bostrom's broader thesis — no discussion of orthogonality, takeoff, or the control problem as a whole. The citation is narrow and the vault keeps it narrow.

    ⚠ not retrieved — cited from the discussion's knowledge, flagged at L383 and L636. Chapter-level attribution is the discussion's, not verified against the book.

    Connections

    • CON-006 — the objective Bostrom's argument installs.
    • CON-007 — the commitment problem that follows from it.

    Back to Shackled AIForests