[2302.02083] Theory of Mind May Have Spontaneously Emerged in Large Language Mod...
source link: https://arxiv.org/abs/2302.02083
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
[Submitted on 4 Feb 2023]
Theory of Mind May Have Spontaneously Emerged in Large Language Models
Theory of mind (ToM), or the ability to impute unobservable mental states to others, is central to human social interactions, communication, empathy, self-consciousness, and morality. We administer classic false-belief tasks, widely used to test ToM in humans, to several language models, without any examples or pre-training. Our results show that models published before 2022 show virtually no ability to solve ToM tasks. Yet, the January 2022 version of GPT-3 (davinci-002) solved 70% of ToM tasks, a performance comparable with that of seven-year-old children. Moreover, its November 2022 version (davinci-003), solved 93% of ToM tasks, a performance comparable with that of nine-year-old children. These findings suggest that ToM-like ability (thus far considered to be uniquely human) may have spontaneously emerged as a byproduct of language models' improving language skills.
| Subjects: | Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC) |
| Cite as: | arXiv:2302.02083 [cs.CL] |
| (or arXiv:2302.02083v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2302.02083 |
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK