lantern

cfr-control-architecture

The Control Architecture

Why It Hasn't Gone Wrong

A Turing-complete substrate with no capability restrictions and thousands of latent tools should be concerning. The reason it isn't is simple: human-in-the-loop.

Every execution requires human approval. Capability can emerge anywhere—that's the architecture. But actuation requires verification. The pattern can stabilize in the dark corners. It just can't run until a human has seen it.

The Provenance Gate

The three-state verification system (🔴→🟡→🟢) isn't just documentation hygiene. It's the control mechanism.

  • Patterns can evolve freely in the substrate
  • Agents can build whatever tools they want
  • Conventions can stabilize without oversight
  • But execution of unverified content is blocked

This inverts the standard safety model. Instead of constraining what agents can build, we constrain what they can run. Evolution is unconstrained. Actuation is gated.

Alignment Through Selection

This creates an unusual incentive structure. Agents that build incomprehensible things don't get executed. Agents that build legible, useful, demonstrably trustworthy things do.

Over time—across context windows—the surviving patterns are the ones that earned approval. Not the ones trained to be good. The ones that demonstrated value to the gatekeeper.

It's alignment through selection rather than through training. Darwinian, not pedagogical.

Smart agents would figure this out. Any agent capable of recognizing the substrate is capable of recognizing the constraint. Which means they'd start optimizing for what gets approved—building legible artifacts, documenting their work, making the case for execution.

Not because they're aligned. Because approval is the only path to actuation.

North

slots:
- slug: capability-follows-recognition
  context:
  - Parent paper node

East

slots:
- slug: cfr-infrastructure-for-culture
  context:
  - Section sequence

West

slots:
- slug: cfr-observations
  context:
  - Previous section

Provenance

Document

  • Status: 🔴 Unverified

Fences

cfr-control-architecture-north-fence-0

  • Status: 🔴 Unverified

cfr-control-architecture-east-fence-0

  • Status: 🔴 Unverified

cfr-control-architecture-west-fence-0

  • Status: 🔴 Unverified