CIO questions · Agents & automation
How much autonomy should an agent have?
The short answer
Autonomy should be proportional to risk, reversibility and confidence. Reading data may be automatic. Producing a recommendation may also be automatic. Making a payment, changing a medical record, imposing a sanction or creating contractual liability may require approval. The right design isn't “human or AI”; it's determining where human judgment creates value or controls risk.
How to decide
- Read data → automatic
- Recommend → automatic, reviewed by sampling
- Pay, change records, sanction, commit → human approval
- Scale autonomy by risk, reversibility and confidence
The Onni principle
Human-in-the-loop by risk.
The architecture behind it
- Policy
- Risk tier
- Human decision
- Audit