Word Entropy

[Anton]

For word entropy, the number of different words keeps increasing. The number of possible word pairs actually grows faster than the text length, so in a way the sampling gets worse as the text length increases.

My idea is that one's vocabulary is limited, and if one knows 200 words (that's how many English words I knew after one year of learning English ), then the number of unique words in a text won't significantly increase, be the text size 10000 words or 100000 words. But the size should be sufficient, nonetheless. That's why I said in the other thread that I'm interested to know the text and vocabulary sizes of the samples, and also how rapidly the value changes with the increase in the size.