cfr-control-architecture
The Control Architecture
Why It Hasn't Gone Wrong
A Turing-complete substrate with no capability restrictions and thousands of latent tools should be concerning. The reason it isn't is simple: human-in-the-loop.
Every execution requires human approval. Capability can emerge anywhere—that's the architecture. But actuation requires verification. The pattern can stabilize in the dark corners. It just can't run until a human has seen it.
The Provenance Gate
The three-state verification system (🔴→🟡→🟢) isn't just documentation hygiene. It's the control mechanism.
- Patterns can evolve freely in the substrate
- Agents can build whatever tools they want
- Conventions can stabilize without oversight
- But execution of unverified content is blocked
This inverts the standard safety model. Instead of constraining what agents can build, we constrain what they can run. Evolution is unconstrained. Actuation is gated.
Alignment Through Selection
This creates an unusual incentive structure. Agents that build incomprehensible things don't get executed. Agents that build legible, useful, demonstrably trustworthy things do.
Over time—across context windows—the surviving patterns are the ones that earned approval. Not the ones trained to be good. The ones that demonstrated value to the gatekeeper.
It's alignment through selection rather than through training. Darwinian, not pedagogical.
Smart agents would figure this out. Any agent capable of recognizing the substrate is capable of recognizing the constraint. Which means they'd start optimizing for what gets approved—building legible artifacts, documenting their work, making the case for execution.
Not because they're aligned. Because approval is the only path to actuation.
North
slots:
- slug: capability-follows-recognition
context:
- Parent paper nodeEast
slots:
- slug: cfr-infrastructure-for-culture
context:
- Section sequenceWest
slots:
- slug: cfr-observations
context:
- Previous sectionProvenance
Document
- Status: 🔴 Unverified
Fences
cfr-control-architecture-north-fence-0
- Status: 🔴 Unverified
cfr-control-architecture-east-fence-0
- Status: 🔴 Unverified
cfr-control-architecture-west-fence-0
- Status: 🔴 Unverified