自動ニュース作成G
生成AIの飛躍的性能アップの秘密「グロッキング」とは？ - GIGAZINE
https://gigazine.net/news/20230531-ai-grokking/
2023-06-01 11:36:58
＞ChatGPTなどの優れたAIモデルを開発するAI研究団体のOpenAIが発見した、ディープラーニングにおける最も魅力的な謎のひとつとされる「グロッキング」
◇
について、GoogleのAI研究者が位相変化との関係を指摘しています。
人間の子供が言葉を覚えたり物心つくときにもこういう相転移があるのかな?
・Coined by American author and aeronautical engineer Robert A. Heinlein in 1961 in his novel Stranger in a Strange Land. The word is described as being from the word for “to drink” and, figuratively, “to drink in all available aspects of reality”, “to become one with the observed” in Heinlein’s fictitious Martian language.
・William Tenn later asked Heinlein if it could have been inspired by the term griggo, which featured in Tenn's 1949 Venus and the Seven Sexes; Heinlein “looked startled, then thought about it for a long time (and) shrugged, (saying) ‘It's possible, very possible.’”[1] 以上、grokの語源