I tend to agree, but I am also still afraid that someone accidentally misconfigures the loss function of GPT-2 and instead of 20 layers of style it discovers five layers of meaning, and comes after us. :)https://twitter.com/dmonett/status/1212992388546932736 …
“Their words are referenced to how many times it appeared in the corpus“ ... in the context of cooccuring other words. And the same is true for the blips on your retina, skin or thalamus.
-
-
Given Neuroscience's perspective, I don't think we recognize things by the repeating pattern in single pixel value combinations. Yes, there are low representation of knowledge, but not single values. Another note is the ability to reflect back on the brain for a more complex […]
-
We don’t have any other access to reality but counting the noisy bits on our systemic interface. Evolving priors is part of counting. Higher order relationships between observed patters is still counting.
- 10 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.