06-11-2025, 10:36 AM
(06-11-2025, 09:57 AM)quimqu wrote: You are not allowed to view links. Register or Login to view.the next word is not random. it depends on the previous two or three words. ... Conditional entropy drops sharply when more context is known
So far this is a property of almost any text written in any natural language. And even of encrypted text, if each original word type is mapped to one encrypted word type. Or to a small number of types.
Because of this property, a Markov model of order 2 (that chooses the next word at random, with frequencies based on the last two generated words) can produce pseudo-English (or pseudo-Mongolian) that is pretty much indistinguishable from the real thing -- to anyone who does not know the language.
Therefore, the results of any word-level analysis of the VMS should be compared to those obtained from a sample of pseudo-Voynichese generated by a Markov of order 2 or 3. Comparing to simple random stream of words (as produced by a Markov of order zero) is not very useful.
A millennium ago, Jacques Guy wrote such a generator, which he called "monkey". Alas I can find neither the program not its output. Maybe some other old-timer kept a copy?
All the best, --stolfi

