Word Entropy

[Koen G]

That's the problem, I'm not sure how the reshuffling of that site I used worked. I just pressed reshuffle each time. But if it shuffles well, shouldn't each successive shuffle be of equal randomness? Maybe I should force cumulative shuffling by pasting the results into the input and see whether that makes a difference.

Note that the graph shows the difference between shuffles and plaintext. So the original is actually the baseline. Also, the graph sorted the data. In the list I posted above, you'll see that the first shuffle doesn't necessarily correspond to the lowest value. Whether these fluctuations are within acceptable bounds or not is something I might test in the way described above.

What does put Timm's text apart somewhat is that its number of word types is really low like English, while its h2 is more like Latin. Normally we would expect a language to compensate low word types with more fixed word order, i.e. lower h2. The VM texts are an outlier in this respect as well, but Timm"s is more so.

I don't know to what extent the relatively low h2 (compared to TTR)  is problematic. But looking at all tested texts (see scatter plot above), this does put the VM and Timm's text apart from the rest.