Someone in the chinese room would not know anything about their in- or output. Sure you memorized that a certain set of symbols means your output should contain another set of symbols, but what do you actually “know” about these symbols.
But you have no idea what it’s about. Is it a greeting? A recipe for some pasta? Instructions to build a bomb?
Could be anything.
don’t know why you got downvoted, an LLM is essentially a chinese room, and whether such a room “knows” is still the question.
Someone in the chinese room would not know anything about their in- or output. Sure you memorized that a certain set of symbols means your output should contain another set of symbols, but what do you actually “know” about these symbols.
But you have no idea what it’s about. Is it a greeting? A recipe for some pasta? Instructions to build a bomb? Could be anything.
Good god it’s a hydra
no, it fucking isn’t. (see the postscript in linked article.)
Thanks for that read.
don’t know why you got banned