06-09-2024, 08:08 PM
In this paper < Distinct word length frequencies: distributions and symbol entropies > by Reginald Smith
Link: You are not allowed to view links. Register or Login to view.
Thanks to Scarecrow, ninja xref: You are not allowed to view links. Register or Login to view.
Smith says,
Further in "Section 2. Distinct word length distributions."
Figure 1. is a "Graph of the frequency of distinct words by word length" for various languages,
where English shows a distribution similar to that of English in Stolfis' Figure 2. [1]
and curiously the language graphs for ES, PT, IT, FR, DE, RU. ( to my eye at least ) show a visual similarity to a binomial distribution.
.
[1] Web archive link to Stolfi page "On the VMS Word Length Distribution" because unicamp link is currently not accessible.
You are not allowed to view links. Register or Login to view.
Link: You are not allowed to view links. Register or Login to view.
Thanks to Scarecrow, ninja xref: You are not allowed to view links. Register or Login to view.
Smith says,
Quote:The literature on [..] Word length frequencies typically investigate the frequency of words of different lengths in syllables.
These distributions are common amongst texts and are typically interpreted as a type of negative binomial distribution [..] or [..] Hyper-Poisson { Displaced Poisson distribution }.
Further in "Section 2. Distinct word length distributions."
Figure 1. is a "Graph of the frequency of distinct words by word length" for various languages,
where English shows a distribution similar to that of English in Stolfis' Figure 2. [1]
and curiously the language graphs for ES, PT, IT, FR, DE, RU. ( to my eye at least ) show a visual similarity to a binomial distribution.
.
[1] Web archive link to Stolfi page "On the VMS Word Length Distribution" because unicamp link is currently not accessible.
You are not allowed to view links. Register or Login to view.

