25-08-2025, 08:30 PM
If the "copy" and "modify" parts of the algorithm are turned off, leaving only a "generate from scratch" step, it reduces to a Markov chain of order zero -- that just outputs words from a fixed probability distribution, without regard for previous outputs.
With the right "generate" algorithm, such a generator can reproduce some statistical properties of the VMS text, such as Zipf law, per-word word entropy, word structure, and glyph and glyph pair distributions, But it cannot produce any word-pair distribution other than (random first word) x (random second word). That is, the next-word entropy would be the same as the plain word entropy.
As I wrote earlier, even with a significant copy probability, the word-pair distribution should gradually tend to this state; since each time the source pointer is reset another random word pair would be added to the repertoire of pairs available for subsequent copying.
With the right "generate" algorithm, such a generator can reproduce some statistical properties of the VMS text, such as Zipf law, per-word word entropy, word structure, and glyph and glyph pair distributions, But it cannot produce any word-pair distribution other than (random first word) x (random second word). That is, the next-word entropy would be the same as the plain word entropy.
As I wrote earlier, even with a significant copy probability, the word-pair distribution should gradually tend to this state; since each time the source pointer is reset another random word pair would be added to the repertoire of pairs available for subsequent copying.