The structure of the Voynich text and how it may be generated
#12
I’ve been trying to build a very simple generative model that reproduces some of the statistical properties of the Voynich text. The idea is not to decode anything, just to see how far a local generative mechanism can go.

The current version mixes a few ingredients. It copies and mutates recent tokens, occasionally samples from globally compatible “families” of words, and adds a small amount of controlled innovation. It also reuses the real line and paragraph structure, so positional effects are not invented but inherited from the manuscript.

Below is a comparison between the Voynich (EVA) and the generated text after mapping from CUVA back to EVA:

FeatureVoynichGenerated
tokens3826238111
types87436882
type_token_ratio0.22850.1806
hapax_share_types0.71950.2448
mean_word_len5.08985.7704
repeat_rate0.00770.0079
H1_char3.88923.8852
H2_char3.13393.2351
H3_char2.79862.9418
H_conditional2.37862.5850
line_initial_len_delta0.38760.6570
line_start_js0.28130.2443
line_end_js0.45570.4120
line_initial_gallows0.54470.7137
paragraph_initial_gallows0.91760.8541
global_density_lev20.07000.0364
local_density_lev20.10460.0546
gap_local_global0.03460.0182

At this point the model already reproduces quite well the global shape of the text. Entropy values are close, repetition rate is correct, and line-level constraints such as initial glyph bias and paragraph behavior are largely captured. In other words, a combination of local memory and positional constraints already explains a good part of the surface structure.

Where it still fails is in the lexical field. The vocabulary is too small, the proportion of hapax is far too low, and the overall Levenshtein connectivity is weaker than in the Voynich. The generated text either reuses forms too much or creates new ones that are not well integrated into the dense network of similar words.

The next step I’m working on is to push “controlled innovation” further. The goal is to generate more new word forms, but not arbitrarily. They need to remain close to existing families and land in regions of the space that are already dense. The Voynich seems to combine constant novelty with strong local similarity, and that balance is exactly what the current model still misses.

I will keep you informed.
[+] 2 users say Thank You to quimqu for this post
Reply


Messages In This Thread
RE: The structure of the Voynich text and how it may be generated - by quimqu - 08-04-2026, 06:54 PM

Forum Jump:


Users browsing this thread: 3 Guest(s)