19-11-2025, 09:33 AM
(19-11-2025, 08:23 AM)ReneZ wrote: You are not allowed to view links. Register or Login to view.This is a lot better, but still fails in a significant way. I suspect that the input text may have been too short.
All things that are superscripts are vowels or tone marks that cannot be separated from the consonant above which they are written. Also, all vowels are strictly bound to the adjacent consonant. Some are written to the left and some to the right but the rules are strict. My guess is that with a longer text this would have been detected.....
Thanks René. The text is quite long:
36782 "words" separated by a space
872639 "chars"
I suppose the issue is that the model detects the vowel chars and it asumes that they should be better treated as single chars. My question: does Thai have single char words? If not, I could set the model not to take into consideration single chars and maybe have a better result.
This resitrictions, on the other hand, are not good to apply to the Voynich. Note that for the MS, I have analysed the single char usage: in order to have a better match with the spaces, we need to have about 7% of the segments as a single chars. My analysis has taken in consideration only the paragraphs and long sentences. No labels.

