About word length distribution

[tikonen]

More specifically on the topic of word length distribution, when speaking of this, it is important to distinguish between the word type distribution and the word token distribution.



The binomial case is for word type lengths, meaning that the approach of throwing dice when writing out the text does not work.



For more information see here: You are not allowed to view links. Register or Login to view.

Correct, the distinct words of a length follow binomial distribution exactly, the token length distribution follows it approximately (less for labels).