Word Entropy

[RenegadeHealer]

Here's with the first 5000 words from Q13 and Q20 tested as well.

There's one point I could use some clarification on, Koen. Were the reshufflings cumulative, or was each reshuffling a different random output of the same (plaintext) input? I'm assuming it's the former, since this simulates an analog randomization process where every shake and shuffle builds upon the results of the last, but the entropy of the assortment approaches an upper limit.

If so, and I'm interpreting the data correctly, Timm's word salad really stands out, and the real VMS clusters with known real language samples. In all the histograms except Timm's, there's a jump up from the plaintext to the first reshuffling, then a noticeably smaller jump up for the second reshuffling, and an even smaller one for the third, such that I don't see the point of doing any more reshufflings. Timm's lorem ipsum soup, meanwhile, plateaus right away. What I see here is an assortment of values that was already almost as random as it could get, and hit essentially maximum entropy in one shake.

I'd say if the VMS was generated by some randomizing algorithm, it must have differed from the one Torsten Timm designed in some significant ways.