Word Entropy

[Koen G]

This graph is a summary of what I've found about 35,000 word texts. It shows percentage of theoretical maximum h2 over TTR. This sounds complicated but actually it's not.
(Note: for max h2 I used (15-h1), this value is probably a bit low, but not much, and it makes no difference for the relative distance between values.)

   

The top line of dots, connected by the pink line, are the scrambled values. The bottom line are original values. Scrambled values are on top because obviously their entropy is higher. Entropies are not expressed as an absolute number, however, but as a percentage of the theoretical maximum entropy for this text.

TTR for scrambled and unscrambled texts are identical because the words stay the same, they are just in a different order.

Observations:
* Focusing on the pink curve, we see that it is pretty consistent. As the amount of word types increases, so does the entropy of the scrambled text.
* The bottom line, h2 of the original texts, varies much more. 
* It is tempting to imagine a line from the bottom left dot (Barlaam unscrambled) through Matthioli and Pliny. The VM and Timm would be above this line.

Another way to visualize this is to plot the difference between scrambled and unscrambled forms of each text. For Pliny, this value is really small already, and the VM barely clings on. Timm's is smaller still.