1 reactions
Vint Cerf on LLMs in Physics Today
"(LLMs) don’t have enough context. I tested this by asking a large language model to write an obituary for me, and it generated a 700-word bio. It gave a date, which I thought was way too soon. It talked about my career. It gave me credit for stuff I didn’t do. It gave other people credit for stuff I did. It made up family members I don’t have.
"This illustrates how large language models produce the verisimilitude of human discourse. They respond as if we had asked, “If you were a human being, what would you say to this prompt?” That’s all. But hiding within is some notion of knowledge because the statistics reflect real texts that have meaning. And so it can feel *as if there’s a ghost in there that understands something*."
https://pubs.aip.org/physicstoday/article/77/11/30/3318195/Physics-AI-and-the-future-of-discoveryLeaders-from/
#science
source
"(LLMs) don’t have enough context. I tested this by asking a large language model to write an obituary for me, and it generated a 700-word bio. It gave a date, which I thought was way too soon. It talked about my career. It gave me credit for stuff I didn’t do. It gave other people credit for stuff I did. It made up family members I don’t have.
"This illustrates how large language models produce the verisimilitude of human discourse. They respond as if we had asked, “If you were a human being, what would you say to this prompt?” That’s all. But hiding within is some notion of knowledge because the statistics reflect real texts that have meaning. And so it can feel *as if there’s a ghost in there that understands something*."
https://pubs.aip.org/physicstoday/article/77/11/30/3318195/Physics-AI-and-the-future-of-discoveryLeaders-from/
#science
source
| 6,000 mlx | |
| 12 | |
| 1 |