novalis
bonked 25 Sep 2023 19:04 +0000
original: jetbougan@mastodon.art
novalis
bonked 25 Sep 2023 19:04 +0000
original: jetbougan@mastodon.art
- Aldous Huxley, Brave New World My wife hypothesizes that Berglund et al (and, as of last check, the HN commentariat) don't mention Huxley is that when we were kids, there were only three dystopias: We, 1984, and Brave New World. So that's what everyone read. Now there are so many that every kid can just ask ChatGPT to generate one to match their specific fears.
“The Nile is the longest river in Africa and the second in length of all the rivers of the globe. Although falling short of the length of the Mississippi-Missouri, the Nile is at the head of all rivers as regards the length of its basin, which extends through 35 degrees of latitude …”
At breakfast the next morning, “Tommy,” some one says, “do you know which is the longest river in Africa?” A shaking of the head. “But don’t you remember something that begins: The Nile is the …”
“The – Nile – is – the – longest – river – in – Africa – and – the – second -in – length – of – all – the – rivers – of – the – globe …” The words come rushing out. “Although – falling – short – of …”
“Well now, which is the longest river in Africa?”
The eyes are blank. “I don’t know.”
“But the Nile, Tommy.”
“The – Nile – is – the – longest – river – in – Africa – and – second …”
“Then which river is the longest, Tommy?”
We expose a surprising failure of generalization in auto-regressive large language models (LLMs). If a model is trained on a sentence of the form “A is B”, it will not automatically generalize to the reverse direction “B is A”. This is the Reversal Curse. For instance, if a model is trained on “Olaf Scholz was the ninth Chancellor of Germany”, it will not automatically be able to answer the question, “Who was the ninth Chancellor of Germany?”. Moreover, the likelihood of the correct answer (“Olaf Scholz”) will not be higher than for a random name. Thus, models exhibit a basic failure of logical deduction and do not generalize a prevalent pattern in their training set (i.e. if “A is B” occurs, “B is A” is more likely to occur).
novalis
bonked 19 Sep 2023 13:39 +0000
original: jk@mastodon.social
two space-based adventures written predominantly in C# include squad's kerbal space program (2015) and debussy's clair de lune (1905)
novalis
honked back 18 Sep 2023 16:37 +0000
in reply to: https://mastodon.social/users/danluu/statuses/111070730283218954
@danluu I think Scott Alexander's framework for thinking about choices in the context of mental illness applies here. I'm not sure whether community-orientation tracks with poverty. I grew up comfortably middle-class (as did both of my parents), but I still sometimes got hand-me-downs because why let good clothes to waste?