Perception is mostly about expectations. You can only perceive what you expect. Even a newborn makes fundamental assumptions about the structure of its sensorimotor space (priors), without which it simply couldn't start making sense of (& learning from) its sensorimotor feed.
-
-
The stronger the assumptions the faster you learn (e.g. densely connected network vs. convnets for spatial perception).
Show this threadThanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Definitely. Which is why it's odd that so little academic literature concerns itself with how to robustly integrate prior beliefs into an ML system. "Mess around with the architecture" doesn't cut it.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Any idea how we could develop a language to impose such beliefs into our systems? multidimensional prior distributions for ABC?
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
I wonder whether this holds true for Genetic Algorithms and Classifier Systems as well. I can set them on evaluation function/external system, and get patterns as a result. What assumptions would be involved there?
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Observation is more fundamental than expectations in learning. Most expectations are also build upon it. Same once a newborn baby who came with no expectations of ML, now learning it.
-
I agree: 1. Smaller the search space, faster will be learning 2. This kind of learning is not possible in supervised learning process. (Where expectations are set) 3. Searching expectations/pattern makes search space much larger and hence makes the learning much more difficult.
End of conversation
New conversation -
-
-
So training data design is a topic to itself? Part of the next incremental step is datasets curated to teach more fundamental concepts?
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.