For 4 months, 54 students were divided into three groups: ChatGPT, Google -ai, and Brain-only. Across 3 sessions, each wrote essays on SAT prompts. In an optional 4th session, participants switched: LLM users used no tools (LLM-to-Brain), and Brain-only group used ChatGPT (Brain-to-LLM).
๐. ๐๐๐ ๐๐ง๐ ๐๐ฌ๐ฌ๐๐ฒ ๐๐จ๐ง๐ญ๐๐ง๐ญ
- LLM Group: Essays were highly homogeneous within each topic, showing little variation. Participants often relied on the same expressions or ideas.
- Brain-only Group: Diverse and varied approaches across participants and topics.
- Search Engine Group: Essays were shaped by search engine-optimized content; their ontology overlapped with the LLM group but not with the Brain-only group.
If you have a fediverse account, you can quote this note from your own instance. Search https://mastodon.social/users/nataliyakosmyna/statuses/114695336750264727 on your instance and quote it. (Note that quoting is not supported in Mastodon.)