Confirmation that spaces are really spaces
#34
(19-11-2025, 08:23 AM)ReneZ wrote: You are not allowed to view links. Register or Login to view.This is a lot better, but still fails in a significant way. I suspect that the input text may have been too short.

All things that are superscripts are vowels or tone marks that cannot be separated from the consonant above which they are written. Also, all vowels are strictly bound to the adjacent consonant. Some are written to the left and some to the right but the rules are strict. My guess is that with a longer text this would have been detected.....

Thanks René. The text is quite long: 

36782 "words" separated by a space
872639 "chars"

I suppose the issue is that the model detects the vowel chars and it asumes that they should be better treated as single chars. My question: does Thai have single char words? If not, I could set the model not to take into consideration single chars and maybe have a better result. 

This resitrictions, on the other hand, are not good to apply to the Voynich. Note that for the MS, I have analysed the single char usage: in order to have a better match with the spaces, we need to have about 7% of the segments as a single chars. My analysis has taken in consideration only the paragraphs and long sentences. No labels.
Reply


Messages In This Thread
RE: Confirmation that spaces are really spaces - by quimqu - 19-11-2025, 09:33 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  [split] Measure uncertain spaces? Koen G 8 1,647 24-08-2026, 08:09 AM
Last Post: Pointless..
  Uncertain spaces as evidence of verbose glyph pairs kckluge 0 1,587 01-01-2026, 05:24 AM
Last Post: kckluge
  n-grams while ignoring spaces? Koen G 10 9,804 17-03-2025, 05:32 PM
Last Post: zachary.kaelan
  Using Massimiliano Zattera's slot sequence or a different one to find missing spaces? nablator 8 8,496 15-05-2024, 12:14 AM
Last Post: ReneZ
  Ambiguous Spaces Emma May Smith 28 21,336 19-03-2024, 09:49 AM
Last Post: MarcoP
  Bigrams across uncertain spaces RobGea 26 21,535 24-05-2022, 07:02 AM
Last Post: MarcoP
  Spaces and Entropy Koen G 32 31,683 22-05-2022, 12:28 AM
Last Post: Anton
  Spaces and word cases Barbrey 0 4,597 26-07-2021, 02:17 AM
Last Post: Barbrey

Forum Jump:


Users browsing this thread: 1 Guest(s)