• Options
• Login
• Desktop Style

Templatic Voynich generator

• Index

  • The Voynich Ninja
  • Voynich Research
  • Analysis of the text
  • Templatic Voynich generator
• Templatic Voynich generator

• RE: Templatic Voynich generator

  nablator > 3 hours ago

  (5 hours ago)dashstofsk Wrote: You are not allowed to view links. Register or Login to view.Would it be possible for your generator to output its text in IVTFF format? And if it could generate 20 pages and about 7000 words total I would then be better able to compare it with quire 13.

  
  A direct comparison to Q13 would require a specific training: some glyph trigrams don't exist, Q13 has a lower MATTR than any other section, m are always at the end of lines.
  
  What I'd like to see is how a text, not generated by any kind of "self-citation" algorithm, but closely modeled on the real text, compares to the VMS in terms of local similarity metrics.

• RE: Templatic Voynich generator

  Labyrinthinesecurity > 3 hours ago

  (5 hours ago)dashstofsk Wrote: You are not allowed to view links. Register or Login to view.Would it be possible for your generator to output its text in IVTFF format? And if it could generate 20 pages and about 7000 words total I would then be better able to compare it with quire 13.

  
  will do next week if I can, thanks!
  

  ---

  nablator dateline='[url=tel:1780673871' Wrote: You are not allowed to view links. Register or Login to view.1780673871[/url]']
  

  dashstofsk dateline='[url=tel:1780667083' Wrote: You are not allowed to view links. Register or Login to view.1780667083[/url]']
  Would it be possible for your generator to output its text in IVTFF format? And if it could generate 20 pages and about 7000 words total I would then be better able to compare it with quire 13.

  
  A direct comparison to Q13 would require a specific training: some glyph trigrams don't exist, Q13 has a lower MATTR than any other section, m are always at the end of lines.
  
  What I'd like to see is how a text, not generated by any kind of "self-citation" algorithm, but closely modeled on the real text, compares to the VMS in terms of local similarity metrics.

  
  interesting,.. which kind of metrics do you have in mind?

• RE: Templatic Voynich generator

  nablator > 3 hours ago

  (3 hours ago)Labyrinthinesecurity Wrote: You are not allowed to view links. Register or Login to view.interesting,.. which kind of metrics do you have in mind?

  
  The one that Torsten Timm used: average edit distance between all words of different lines. See the comparison with other texts here: You are not allowed to view links. Register or Login to view.
  I guess there should be no detectable effect (local inter-line similarity) on your generated text.
  
  I wrote a babble detector very recently based on Byte Pair Encoding, not optimal compression I know, so the results are a bit random, but it does seem to find the babble-like sequences quite efficiently (in a window of n words) so it's good enough for a quick comparison of the amount of such sequences. I suppose your generated text should behave like a word-shuffled version of the section(s) it has been trained on, i.e. less babble-like.
  
  For the comparison to be more significant I guess some LAAFU statistics and inter-word statistics would be helpful, they might add a little bias in local similarity. They probably don't matter for the average edit distance between all words of different lines but might impact a little the babble detector on very short sequences of words. For this I used character trigrams statistics with special characters for line start and line end in my simple Markov chain generator (without word model, so the word length distribution was very wrong).
• Next Oldest Next Newest