Experiments with language corpora
#10
Thank you, Rene!

I understand your conclusion about the sample being too short to properly evaluate Korean. It should be possible to find a longer text encoded in the same way and see what happens. But, after your discussion of the issue, I think this is interesting but not terribly relevant. Voynich-wise, your observation that H1 and H2 are extremely high in Korean suggests that looking at conditional entropy alone is not enough. One can say that a sample text has an entropy behaviour similar to another sample only if H1 in sample A is close to H1 in sample B, and the same holds for H2 (and conditional entropy would be close too, since it is defined as H2-H1). 

I guess that the H1 value for Korean is reasonably accurate, even if the text is short. Voynichese has an H1 value lower than 4, totally incompatible with the 7.09 of Korean.

In the next days. I will try comparing the UDHR samples with the VMS taking into account the different entropies.
Reply


Messages In This Thread
Experiments with language corpora - by MarcoP - 09-05-2018, 03:15 PM
RE: Experiments with language corpora - by ReneZ - 09-05-2018, 04:45 PM
RE: Experiments with language corpora - by MarcoP - 09-05-2018, 05:49 PM
RE: Experiments with language corpora - by Koen G - 09-05-2018, 05:17 PM
RE: Experiments with language corpora - by MarcoP - 09-05-2018, 06:40 PM
RE: Experiments with language corpora - by ReneZ - 09-05-2018, 06:45 PM
RE: Experiments with language corpora - by MarcoP - 09-05-2018, 07:23 PM
RE: Experiments with language corpora - by ReneZ - 11-05-2018, 06:58 PM
RE: Experiments with language corpora - by MarcoP - 11-05-2018, 08:14 PM
RE: Experiments with language corpora - by MarcoP - 19-05-2018, 10:56 AM
RE: Experiments with language corpora - by Koen G - 11-05-2018, 10:30 PM
RE: Experiments with language corpora - by ReneZ - 12-05-2018, 07:35 AM
RE: Experiments with language corpora - by MarcoP - 12-05-2018, 07:15 PM
RE: Experiments with language corpora - by -JKP- - 12-05-2018, 09:59 PM
RE: Experiments with language corpora - by DONJCH - 28-05-2018, 09:57 PM
RE: Experiments with language corpora - by MarcoP - 29-05-2018, 11:21 AM
RE: Experiments with language corpora - by DONJCH - 03-06-2018, 02:50 AM
RE: Experiments with language corpora - by MarcoP - 03-06-2018, 08:44 AM
RE: Experiments with language corpora - by ReneZ - 03-06-2018, 05:59 AM
RE: Experiments with language corpora - by DONJCH - 03-06-2018, 08:29 AM
RE: Experiments with language corpora - by ReneZ - 04-06-2018, 06:26 AM
RE: Experiments with language corpora - by MarcoP - 27-09-2018, 11:38 AM

Forum Jump:


Users browsing this thread: