-
Show this thread
-
Replying to @fire__exit
think about how few words you need in a quoted phrase to find a single match, even ordinary words
1 reply 0 retweets 1 like -
Replying to @literalbanana @fire__exit
for instance, prev is the sole tweet with “you need in a quoted” in it
1 reply 0 retweets 1 like -
Replying to @literalbanana @fire__exit
“implausible that novel strings” occurs only in your tweet out of the whole internet
1 reply 1 retweet 1 like -
Replying to @literalbanana
it's not that 15% is high or low, but that new strings are introduced to google at a constant proportion of previous strings
2 replies 0 retweets 2 likes -
-
Replying to @fire__exit
ah I see - hm imagine if all the two-word strings are non-novel and all the three-word strings and above are mostly all novel
3 replies 0 retweets 0 likes -
Replying to @literalbanana
any modeling is complicated by the introduction of new words and characters as well as news and other real world events
1 reply 1 retweet 1 like -
-
This strikes me as a straightforward/unsurprising extension of Zipf's Law
-
-
Replying to @djinnius @literalbanana
you've reminded me i had this lying around, i'll get back to youpic.twitter.com/bQu9TXhPKH
1 reply 0 retweets 2 likes -
Replying to @fire__exit @literalbanana
Nice! I wanted to find a copy so I typed "Zipf's law phrases words" (probably novel search): http://dspace.mit.edu/bitstream/handle/1721.1/98434/Williams-2015-Zipf's%20law.pdf …
0 replies 0 retweets 3 likes
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.