I am reaching a little bit but why not? @fchollet I am reading your paper: https://arxiv.org/abs/1911.01547 (for the 3rd time I think) why is it that generalization has necessarily a cost that makes it antagonistic to compression in the Occam's Razor sense? @RobertTLange?
-
-
The most compressed model that does X is only capable of doing X. If it could do more then you could compress further.
-
I think I might be mistaking your point about compression with the "representation" needed to do good compression. It's just that for me if my brain is making skill programs to handle new situations, the ability to represent efficiently information seems like an important feature
End of conversation
New conversation -
-
-
Yeah, with respect to that I got a bit confused (don't mind me I am really slow..). So, if the generalization difficulty is some measure of the gap between the minimal time it takes to learn a useful skill program and how long it takes for that program to do well on novelty
-
Isn't this definition to a specific variation of what generalizion could be? I am thinking here something like, if I can compress information ok I loose information but don't I gain in terms of reach? I think I might be confusing this with making something like "universality"
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.