Templatic Voynich generator
#13
(05-06-2026, 04:39 PM)Labyrinthinesecurity wrote: You are not allowed to view links. Register or Login to view.interesting,.. which kind of metrics do you have in mind?

The one that Torsten Timm used: average edit distance between all words of different lines. See the comparison with other texts here: You are not allowed to view links. Register or Login to view.
I guess there should be no detectable effect (local inter-line similarity) on your generated text.

I wrote a babble detector very recently based on Byte Pair Encoding, not optimal compression I know, so the results are a bit random, but it does seem to find the babble-like sequences quite efficiently (in a window of n words) so it's good enough for a quick comparison of the amount of such sequences. I suppose your generated text should behave like a word-shuffled version of the section(s) it has been trained on, i.e. less babble-like.

For the comparison to be more significant I guess some LAAFU statistics and inter-word statistics would be helpful, they might add a little bias in local similarity. They probably don't matter for the average edit distance between all words of different lines but might impact a little the babble detector on very short sequences of words. For this I used character trigrams statistics with special characters for line start and line end in my simple Markov chain generator (without word model, so the word length distribution was very wrong).
[+] 1 user says Thank You to nablator for this post
Reply


Messages In This Thread
RE: Templatic Voynich generator - by bi3mw - 04-06-2026, 10:45 PM
RE: Templatic Voynich generator - by oshfdk - 05-06-2026, 12:47 PM
RE: Templatic Voynich generator - by Koen G - 05-06-2026, 10:11 AM
RE: Templatic Voynich generator - by nablator - 05-06-2026, 11:49 AM
RE: Templatic Voynich generator - by Mauro - 05-06-2026, 12:30 PM
RE: Templatic Voynich generator - by Mauro - 06-06-2026, 06:07 PM
RE: Templatic Voynich generator - by dashstofsk - 05-06-2026, 02:44 PM
RE: Templatic Voynich generator - by nablator - 05-06-2026, 04:37 PM
RE: Templatic Voynich generator - by nablator - 05-06-2026, 05:04 PM
RE: Templatic Voynich generator - by Dunsel - 06-06-2026, 04:16 AM
RE: Templatic Voynich generator - by nablator - 06-06-2026, 06:35 PM
RE: Templatic Voynich generator - by oshfdk - 08-06-2026, 02:44 PM
RE: Templatic Voynich generator - by Mauro - 08-06-2026, 05:43 PM
RE: Templatic Voynich generator - by Mauro - 09-06-2026, 07:45 AM
RE: Templatic Voynich generator - by petronio - 10-06-2026, 06:07 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Output from a Voynich generator I'm working on. Dunsel 18 4,098 16-05-2026, 08:44 PM
Last Post: Dunsel
  Voynich text generator Torsten 47 55,859 28-04-2020, 10:34 PM
Last Post: Ger Hungerink

Forum Jump:


Users browsing this thread: