black O2, inc.
ACTIVE
    FOR-001 / PeopleFIG-005

    Dario Amodei

    Active person

    CAUTION This record carries a caution marking. Read it before relying on it.

    title
    Dario Amodei
    Type
    person
    Identifier
    FIG-005
    Status
    Active
    Tags
    • figure
    • alignment
    • shutdown
    Aliases
    • Amodei
    connections
    • [[CON-006]]
    • [[PSG-012]]

    Dario Amodei

    Co-author, with Alex Hadfield-Menell, of The Off-Switch Game (CIT-003, arXiv:1611.08256) — the formal statement that an agent which believes shutdown is bad for its objectives has an incentive to prevent shutdown, not from malice but because the same optimisation that makes it useful makes it self-preserving.

    In the Corpus

    The off-switch result is the corpus's cleanest formal support for the bomb critique: it converts "a kill switch creates an adversary" from an intuition into a result with a model behind it. The corpus's phrasing — "not maliciousness, but the same optimization" — is doing real work, because it locates the defect in the structure of goal-directedness rather than in the agent's character.

    ⚠ not retrieved — the arXiv identifier is given by the discussion (L636), not checked. The vault records the identifier as a claim about a source. If the identifier is wrong, the citation fails even though the argument is well attested; that is exactly the failure mode the register exists to catch.

    Connections

    • CON-006 — the objective structure the result depends on.
    • PSG-012 — the passage that uses it.

    Back to Shackled AIForests