Judgment
Human judgment should scale with machine intelligence.
Intelligence can inform decisions. Human values must define their direction.
- The question
- Who determines what should happen?
- Capability
- Direction
- Outcome
- Decisions reflect meaningful human intent.
- In our promise
- As intelligence advances, we give people more power to understand, decide, and shape their own futures.
Who determines what should happen?
AI systems can make more and more decisions on their own, but capability is not the same as judgment. Judgment involves context, priorities, trade-offs, accountability, and an understanding of what matters.
As intelligence becomes more autonomous, those things should stay grounded in human and organizational intent. Not through a person approving every action, but through people defining the intentions, priorities, and boundaries that autonomous systems act within.
One where human judgment scales alongside machine intelligence.From the manifesto
Execution is scaling faster than judgment.
Autonomous systems act continuously. The decisions meant to steer them still travel at the speed of meetings, memos, and release cycles.
- Benefit leadership is aiming for
- Benefit the agent delivers
- Benefit lost to the gap
Net negative: the gap outweighs everything the agent delivered.
Net positive: nearly all of the intended benefit, delivered.
With judgment on a delay, this agent spends 4 of its 8 months working in a direction nobody wants anymore, and the benefit lost to that gap outweighs everything it delivers. Busy, fast, and net negative. That’s why human agency has to live in definition, alignment, and governance, not at a checkpoint. AI should serve the current intentions of the people it acts for.
Preserve human intent as intelligence becomes autonomous.
Our judgment technologies:
- Preserve human intent as AI autonomy increases.
- Allow organizational priorities to evolve.
- Support accountability for consequential decisions.
- Make it possible to align autonomous behavior with current human intentions.
None of the three works alone.
Agency comes from the relationship among all three. Judgment needs the other two, and they need it.
Judgment without clarity risks decisions based on incomplete or misleading understanding.
Autonomy without judgment creates choices without enough direction.
Clarity
Make increasingly complex information environments understandable.
Autonomy
Give people greater control over their boundaries and choices.
What we’re building for judgment.
Judgment is a lasting commitment. Each venture is one way to deliver it, and we’ll build more as capabilities and human needs evolve.