Tweetovi
- Tweetovi, trenutna stranica.
- Tweetovi i odgovori
- Medijski sadržaj
Blokirali ste korisnika/cu @santoroAI
Jeste li sigurni da želite vidjeti te tweetove? Time nećete deblokirati korisnika/cu @santoroAI
-
Adam Santoro proslijedio/la je Tweet
A paper supporting our observation (https://arxiv.org/abs/1910.00571 ) that egocentric perspective improves generalization in RL!https://twitter.com/hardmaru/status/1223490316134543362 …
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Very nice paper! Multi-modal alignment allows for unsupervised discovery of concepts/labels/meaning. IMO these ideas will eventually allow language models to exhibit deep "understanding" of text, and will solve the "lack of common sense" problemhttps://twitter.com/ProfData/status/1218202528942301186 …
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Adam Santoro proslijedio/la je Tweet
New paper w
@BDRoads, "Learning as the Unsupervised Alignment of Conceptual Systems". Supervised learning tasks can be solved by purely unsupervised means by exploiting correspondences across systems (e.g., text, images, etc.). 1/5 https://www.nature.com/articles/s42256-019-0132-2 …pic.twitter.com/fbMAeCZSvl
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Adam Santoro proslijedio/la je Tweet
When neuroscience and AI researchers get to chatting, cool stuff happens! My first, and I hope not last, trip into neuroscience has been published in Nature. 1/https://twitter.com/DeepMind/status/1217510884085583873 …
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
This logic is especially grating for studies proposing new functions/computations: "We think brain area X might be doing Y. BTW, we can totally imagine how Y would be selected for in evolution. Therefore it's even more probable that X does Y."
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Proving a trait is beneficial (or worse, hypothesizing that it *could* be beneficial) is not sufficient evidence that it is an adaptation. Too many papers throw in statements speculating adaptations, and I don't know why. Especially papers that have nothing to do with evolution
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Adam Santoro proslijedio/la je Tweet
I'm increasingly asked general questions about language by AI and ML practitioners who are interested to start working on it (or who already do so without considering the domain too much) I find my perspective to be quite different from a lot of NLP researchers and intros. 1/2
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
Adam Santoro proslijedio/la je Tweet
Some people in ML share the illusion that models expressed symbolically will necessarily/magically generalise better compared to, for example, parametric model families fit on the same data. This belief seems to come from a naive understanding of mathematics 1/5
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Adam Santoro proslijedio/la je Tweet
Rephrasing
@ylecun with my own words: DL is a collection of tools to build complex modular differentiable functions. These tools are devoid of meaning, it is pointless to discuss what DL can or cannot do. What gives meaning to it is how it is trained and how the data is fed to itPrikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Every time I watch a debate I end up asking myself why I ever bother to watch debates
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Hmm, about that whole "compositionality" thing...
@FelixHill84https://twitter.com/tkasasagi/status/1206856879483174912 …
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
I'd argue it's more than this, since we shouldn't assume a child is only taking advantage of a single ancestral line. There's massive parallelism in the population of ancestors that either directly or indirectly influence a single person's genomehttps://twitter.com/karpathy/status/1206064174129930240 …
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
I think the ability will emerge when models perform *many* tasks, live in a rich world with ample opportunity for grounding of many types, and consistently use analogy. And I'm fully aware of the irony saying this after having built a dataset to test systematic generalization
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
IMO models will not display systematic generalization when trained on small, hand-crafted datasets designed to measure systematic generalization, unless we build tons of non-general priors. 1/2
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Had the pleasure of reading a draft of this, and I cannot recommend it enough. Please read it if you're at all interested in the role of language in intelligencehttps://twitter.com/FelixHill84/status/1205541422742552577 …
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Arguing against the repurposing hypothesis, wherein conceptual structuring uses navigation machinery: "we suggest there are no intrinsic ‘place’ or ‘grid’ cells, but instead a flexible system that will represent the relevant variables at hand, including physical space"https://twitter.com/ProfData/status/1205175643538939905 …
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
"The term biological plausibility should be dropped and instead researchers should clearly state the relevant datasets they intend to address with their theory or model. " I think this exact logic should also apply to AI research and the notion of models' "understanding"
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Love it --> "To be charitable, when neuroscientists claim biological plausibility it is possible they are quietly entertaining some empirical finding that is consistent with their preferred model rather than a vague unsubstantiated intuition."
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
"Although there can be a tendency[...]to dismiss higher-level explanations[...]as biological implausible or not real[...]this makes as much sense as stating that a sorting algorithm, a car's engine, the heart, or the hippocampus is not real because it can be further decomposed."https://twitter.com/KordingLab/status/1204425553547321350 …
Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.
