There's a big difference between data-efficiency and information-efficiency. We could make considerable progress on the former without even starting to approach the latter -- and never realize our fundamental mistake.
Show this thread
-
Abstraction is the golden path to information efficiency. But all kinds of hacks can get you data efficiency.
Show this thread
The difference between data & information: - Data is plentiful & noisy, the large majority of data is not information - Information is what makes data useful - We are bad at extracting info from data. We only manage to distill & use a small fraction of what is really available
-
-
Working on "data efficiency" typically means finding new hacks to increase the amount of information we can extract from the same data. But "information efficiency" is an entirely unrelated concept: how to efficiently and effectively make use of information
Show this threadThanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
You have to play an optimization game which is: 1. Maximize information 2. Minimize Data That's all, folks!
#USA1 42#NWO 99>1pic.twitter.com/lRHpEbvKZ9Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
I kind of disagree, even when I do agree on the importance of understanding this topic. The statement implicitly assumes that there is an entity (agent) receiving the data and extracting information. In that sense information is subjective to the agent 1/
-
I believe that in general we use 'information' in the objective and subjective ways and both are correct. The data being noisy or not is subjective; conceptually, all data (including white noise) is information for the right receiver since it has a causal link with its source 2/
- Show replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.