Loading slide

What Understanding Actually Is

  1. 01What Understanding Actually Is
  2. 02Back to the feeling
  3. 03The Chinese Room
  4. 04What Searle was saying
  5. 05Memory card
  6. 06The systems reply
  7. 07The Searlese Room
  8. 08It cuts both ways
  9. 09No right answer
  10. 10What humans actually do
  11. 11Does it understand?
  12. 12The line keeps moving
  13. 13Two kinds of intelligence
  14. 14The question Turing left us
  15. 15Reinforce your understanding
  16. 16Question: Chinese Room
  17. 17Question: The systems reply
  18. 18Question: Narrow vs general
  19. 19Quiz: answer
  20. 20Still open
  21. 21Want to go deeper?
8 / 20
BackNext

It cuts both ways

This pushes back on Searle's own argument.

His whole case rested on a feeling. "I'm in the room following rules, and I just know I don't understand Chinese." The certainty came from the inside, from how it felt to be him.

But the simulated Searle feels exactly the same certainty. He follows his rulebook and writes "Yes, I'm conscious, I just know it" with the same conviction. If a rulebook can produce that feeling, then the feeling proves nothing. It is just another output.

And here is the part that bites. If you say the rule-following Searle is a mindless fake with no real understanding, you have a problem. The real Searle runs on rules too. His brain cells follow chemistry the same way the operator follows the book.

So either rule-following can add up to a real mind, or the real Searle never had one either. That confident sense that there is someone home, the thing he trusted most, might just be the story his own machinery tells him.

Citations(2)↓
  1. 1. plato.stanford.edu
  2. 2. web-archive.southampton.ac.uk