*(Exceptions to this: (1) the big body of work--including yours--into whether the models absorb bias and (2) the GPT-2 staged roll-out paper (and references cited in its sec 1.)https://arxiv.org/abs/1908.09203
-
Näytä tämä ketju
-
Thus, the motivation for writing this paper. We aren't saying "LLMs are bad" but rather: these are the dangers we see, that should be accounted for in risk/benefit analyses and, if research proceeds in this direction, mitigated. >>
1 vastaus 7 uudelleentwiittausta 61 tykkäystäNäytä tämä ketju -
Furthermore, I've now had a minute to read your critique, and I disagree with your claim that our criticisms are independent of model size. Difficulty in curating and documenting datasets absolutely scales with dataset size, as we clearly lay out in the paper: >>pic.twitter.com/CKLsFXIKwD
1 vastaus 11 uudelleentwiittausta 69 tykkäystäNäytä tämä ketju -
Likewise, nowhere do we say that small LMs are necessarily good/risk-free. There, and in your points about smaller models possibly being less energy efficient, you seem to have bought into a world view where language modeling must necessarily exist and continue. >>
1 vastaus 2 uudelleentwiittausta 27 tykkäystäNäytä tämä ketju -
This isn't a presupposition we share. (And please don't misread: I'm not saying it should all stop this instant, but rather that research in this area should include cost/benefit analyses.) >>
1 vastaus 1 uudelleentwiittaus 27 tykkäystäNäytä tämä ketju -
As for the claim that our paper is one-sided, this is exhausting. All of ML gets to write papers that talk up the benefits of the tech without mentioning any risks (at least until 2020 w/broader impact statements), but when a paper focuses on the risks, it's "one-sided"? >>
5 vastausta 56 uudelleentwiittausta 367 tykkäystäNäytä tämä ketju -
Furthermore, the "debate" you would like us to acknowledge is based on a false premise. As we lay out in detail in Sec 4, the training data emphatically do NOT represent "the world as it is". >>
2 vastausta 1 uudelleentwiittaus 79 tykkäystäNäytä tämä ketju -
❄️Emily M. Bender ❄️ uudelleentwiittasi ❄️Emily M. Bender ❄️
And lastly, miss me with the claim that our work is "political" and therefore has a responsibility to "present the alternative views". See also: https://twitter.com/emilymbender/status/1349844030809542656 … >>
❄️Emily M. Bender ❄️ lisäsi,
❄️Emily M. Bender ❄️ @emilymbenderReading a critique of my paper with@timnitGebru (et al) which claims that if you do science (or scholarship) from the point of view that white supremacy is bad, then you have to make that point of view explicit lest any readers who disagree "mistake it for science". I can't evenNäytä tämä ketju3 vastausta 12 uudelleentwiittausta 109 tykkäystäNäytä tämä ketju -
We draw on scholarship from a range of fields that looks at understanding how systems of power and oppression work in society. >>
1 vastaus 2 uudelleentwiittausta 48 tykkäystäNäytä tämä ketju -
The claim that this kind of scholarship is "political" and "non-scientific" is precisely the kind of gate-keeping move set up to maintain "science" as the domain of people of privilege only. /fin
3 vastausta 16 uudelleentwiittausta 170 tykkäystäNäytä tämä ketju
Some of us seem to have the privilege of publishing political screeds disguised as science. Others (poor souls) still think there's a distinction between scholarship and activism.
Lataaminen näyttää kestävän hetken.
Twitter saattaa olla ruuhkautunut tai ongelma on muuten hetkellinen. Yritä uudelleen tai käy Twitterin tilasivulla saadaksesi lisätietoja.