Measuring Long-Range Structure in the Voynich Manuscript

[quimqu]

I am confused about what what you mean by "word shuffled" and "token shuffled".  Is that a random permutation of the tokens on each line, on each parag, or on the whole text?

Random permutation of word tokens on the whole text from paragraphs of Currier A and (separately) B pages only for me.

For me, in post #2 I compare:

- Original text
- Tokens shuffled (words preserved internally, but reordered)
- Lines shuffled
- Full character shuffle

(it is interesting to see how any shuffling (words, lines or characters) make the MI tend to the same value; but the raw Voynich tends to a value a bit higher)

And from there, it is always word token shuffled (keeping the words, but randomly reordered).