Back to selected work
Concept · Model behavior foundation

Human Oversight for agentic AI

A behavioral framework that decides, action by action, when an AI assistant should act on its own, tell you afterward, advise you, or stop and wait for your approval.

Role: Author, Model Behavior Design Year: 2026 Modality: Chat & voice Status: Draft concept
Agentic AIHuman-in-the-LoopTrust CalibrationBehavior SpecsRisk Taxonomy
The problem

Once an assistant can act, "ask first?" becomes the central design question.

An assistant that only answers questions can be wrong without lasting damage. An assistant that updates records, submits transactions, or sends messages can do harm that is hard to undo. Most teams handle this with a binary switch: confirm everything, or confirm nothing.

Both extremes fail. Confirming everything trains people to click "Approve" without reading, which is worse than having no gate. Confirming nothing hides consequential actions behind an undo button that may come too late.

What I did

I replaced the binary switch with a five-level autonomy spectrum.

I designed a shared behavioral layer that every agentic pattern inherits. Each action is classified by risk before it runs, and the risk sets how much human involvement it needs. Human-in-the-loop (L3, L4) and human-on-the-loop (L0, L1) become positions on one scale, with an advisory level between them.

Select a level to see how it behaves and how it appears in the interface.

Try it · Decision logic

Classify an action.

The framework runs an ordered set of checks. The first "yes" decides the level, so the most restrictive condition always wins. Pick a scenario, or toggle the checks yourself.

Key design decisions

Every statement carries a firmness level.

A behavior spec is read by prompt engineers, developers, evaluators, and designers, and each of them needs to know which lines are hard limits. I tagged every statement so the spec translates cleanly into system prompts and automated checks.

Rule

Non-negotiable

Goes straight into system prompt instructions or hardcoded logic. A violation is always wrong.

Heuristic

Strong default

Holds unless a documented exception applies. Exceptions are written inline, next to the heuristic.

Guidance

Advisory context

Shapes designer and implementer judgment. Never appears in prompts or automated checks.

Three rules anchor the whole system:

  • O7When classification is uncertain, default to L3. Uncertainty itself is treated as risk.
  • T2When a chain spans several risk levels, its most restrictive step sets the level for the whole chain.
  • O8Never place an approval gate after a side effect has already happened.
Approval lifecycle

Editing is a first-class state.

At L3 and L4, an action moves through fixed states that patterns may not skip or collapse. Most confirmation dialogs offer only approve or cancel. Here the user can change the proposed action in place, and a rejected action produces no side effects, including partial ones.

Proposed→ Under review↔ Editing→ Approved→ Executed or Rejected

The framework covers two kinds of gate: an action gate, before the assistant changes something in a system, and a content review gate, before generated content is sent or stored. The content gate keeps the original output and the approved version, with the diff, as a traceability record.

Decision quality

A gate only helps if the person can decide well.

Every oversight moment at L2 and above must carry six elements. A generic "Are you sure?" fails this test.

ElementWhat it covers
ActionAn active-verb statement of exactly what will happen
ScopeTargets, quantities, and boundaries of the action
ImpactWhat changes, in plain language, and who or what is affected
ReasonWhy this level of oversight applies right now
AlternativesEdit and reject paths, as prominent as approve
RecoveryWhat cancelling means, and what can and cannot be undone
Friction balance

Too many gates is its own failure.

If people rubber-stamp approvals, the system has too many gates or too little context. I wrote the friction rules and anti-patterns as explicitly as the safety rules, so teams can push back on over-gating with the same authority as under-gating.

Silent auto-execution with buried undo

Undo is a recovery tool. It does not replace oversight before the action.

Payload-hiding confirmation

An approval that does not show what will execute is a rubber stamp.

Global bypass toggle

"Always allow" for a whole category, with no re-prompt for higher-risk actions.

Warning fatigue

Advisories on every response. People stop reading them, so they must stay rare.

Monitoring at L0 and L1

Autonomy still needs to be watchable.

When the assistant runs without approval, every step goes into an expandable action log, successful calls included. Exceptions do not wait in the log for someone to notice: a low-confidence step pauses and escalates to L3 for that step only, and an unexpected side effect blocks further execution.

[14:32:01] ✓  Called search_docs · query "Q3 revenue" · 3 results · View details
[14:32:04] ✓  Read vendor-master · LF-00442 · View details
[14:32:09] ⚠  Low confidence on intent · Paused for clarification
What's next

Open questions for voice.

Voice users are often multitasking, which strains every assumption a screen-based gate makes. These questions are still open. I kept them in the spec as flagged items so no voice pattern ships as if they were solved.

Let's design better conversations.

Happy to walk through this framework, or any of my work, in more detail.