Loading slide

What Agents Can and Can't Do

  1. 01What Agents Can and Can't Do
  2. 02Where agents shine
  3. 03Where they break
  4. 04Memory card
  5. 05The alignment question
  6. 06Reinforce your understanding
  7. 07Question: Matching oversight to stakes
  8. 08Question: Saying what you mean
  9. 09Quiz: answer
  10. 10Capable and imperfect
  11. 11Want to go deeper?
1 / 10
BackNext

Module X

Agents

Chapter II

What Agents Can and Can't Do

In this chapter

  • Where agents shineclear steps, checkable work, recoverable mistakes
  • Where they breakhow an early error snowballs across a long run
  • The alignment questionwhen what it does is not what you meant
  • Matching oversight to stakeshow much leash to give, and when

Two words that sound alike but are not: capable and reliable. An agent can be wildly capable and, at the same time, not to be trusted to run unattended. Holding both of those in your head at once is the whole skill of this chapter.

On the capable side, an agent can research a question across dozens of sources, write code and run it, sort and rename a pile of files, and stitch several systems together, collapsing hours of careful human clicking into minutes.

On the unreliable side, it inherits every weakness of the model underneath, the confident wrong answers, the missing sense of its own uncertainty, and then it adds a brand new one we just met: in a loop, mistakes do not stay small. A slip at step three, built on in good faith, is a serious mess by step seven. And the model has no instinct to pause and say "wait, let me check that."

The interesting questions all live in the gap between those two sides, between what an agent can do and what you can safely let it do alone.

Citations