America/Bogota
blog // post
session
All posts
2026-09-14

Human-in-the-loop is the product, not the fallback

If automation hides the decision in ops-heavy B2B, you did not ship a product. You shipped a liability. Human judgment is the contract, not plan B.
2026-09-14
Builders love to treat human-in-the-loop as a temporary shame: the thing you remove once the model, the script, or the RPA path is "good enough." In ops-heavy work, that framing is backwards. The judgment step is not a crutch. It is the product.
The failure mode is a system that produces a confident output while the real decision — hire or not, proceed or stop, trust or escalate — still belongs to a person who no longer sees the evidence. If your automation moves typing but buries the reasons, you did not free judgment. You hid it. That is how silent errors become hiring delays, compliance risk, and operators who stop believing the button. I wrote about kill conditions in Falsifiable automation. This is the twin: define where the human must stay visible before you celebrate the autonomous path.
On surfaces like ECORPA, customers are not buying a spinner that finishes. They are buying a reliable path to a decision under messy third-party portals and incomplete data. The human in the loop is how that promise stays honest when the happy path lies. Personal tools on tools.danieldiaz.dev can be stricter and quieter — often I am the only operator. Company product cannot pretend the same. Same craft of systems. Different contract with the user. That separation of promises is why tools and company stay apart.
  1. Evidence before action — the screen that asks for judgment must show the inputs the model or script used, not only the recommendation.
  2. Loud disagreement — when automation and the operator diverge, the system records it. Divergence is signal, not embarrassment.
  3. Bounded autonomy — automate preparation and routing; keep the irreversible commit behind an explicit human step until a falsifier says otherwise.
If you cannot name which step is irreversible, you are not ready to remove the human. You are ready to remove accountability.
  • A flow that ends in "success" while the decision owner still opens three other tabs to verify.
  • A bot that skips the judgment screen because the demo looked clean.
  • A metric that counts completed runs without counting overturns after human review.
Those are theater with better CI. They fail the same bar as the drawer stories in The 99% that stays in the drawer: contact with reality, not a highlight reel.
  1. Can the operator see why the system suggests X?
  2. Is the irreversible step explicitly owned by a human until proven otherwise?
  3. Do we measure overturns and time-to-judgment, not only throughput?
  4. When a third-party portal moves, does the human still get a safe path — or only a broken auto path? (see When the portal moves)
  5. Would I turn off the "autonomous" branch if overturns spike for two weeks?
If the answer to (5) is "we would never turn it off," you are not shipping a product. You are shipping a story that operators already stopped trusting. Human-in-the-loop is not the fallback for weak automation. In this class of work, it is the product surface. Automation earns the right to prepare the decision — not to erase it.