An Artificial Construction

[oshfdk]

Have you tested the East Asian monosyllabic languages - Chinese,Vietnamese, Tibetan, Thai, Burmese, Lao, Khmer, ...

As I said, I haven't tested anything yet, for the test I need a suggestion of the central character and the word separation algorithm. The main objection raised in recent posts here is that the property that @dashstofsk demonstrated for k words in Voynichese can occur in natural languages. I can't see how this is possible. For this experiment we need to select a central character or sequence (that would replace k in this experiment, let's call it B) and the chunking algorithm (the simplest would be using spaces). I can't select these, because for me it's obvious that any selection would be immediately wrong. To make it clear again, the test would be first to split the text into chunks according to the chunking algorithm (just split by spaces in the simplest case), extract all chunks that contain B, treat them as ABC where A and C are the prefix and the suffix and compute the statistics of co-occurrence of all prefix/suffix pairs vs the expected number of prefix-suffix pairs given the frequency of the prefix and the suffix.

I believe this test would work for any natural representation of the language (phonetic, ideographic), just due to the way texts in natural languages are structured, and the prefix and suffix combinations won't be statistically independent for most pairs.