Split: Entropy digression
#1
(07-07-2026, 09:39 PM)Stefan Wirtz_2 wrote: You are not allowed to view links. Register or Login to view.Those entropy calculations are still very depending upon the type of transliteration;
some more aggressive "experts" here are favourizing an "h2" of 2.3 for Voynichese, while the change of transliteration file can produce a value of ~2.9.

As @nablator already pointed out, this is not correct. You wrote that this value was reported for the v101 transliteration. I just recomputed this with my own tools, stripping the transliteration of all annotations, but keeping the full character set.

The v101 file uses 158 different characters, if one counts the space also as a character.
 
Computing the entropy values, also counting space as a character yields:
Single char entropy     H1 =  4.036
Character pair entropy H2 =  6.608
Conditional ch entropy h2 =   2.572

More realistic is not to count space as a character (it isn't). Then:
Single char entropy     H1 =  4.131
Character pair entropy H2 =  6.501
Conditional ch entropy h2 =   2.370

In this case, character pairs spanning a space are not included in the statistics.

The most representative value is 2.37.

Comparison values may be found here: You are not allowed to view links. Register or Login to view.
and here: You are not allowed to view links. Register or Login to view.
Reply


Messages In This Thread
Split: Entropy digression - by ReneZ - 08-07-2026, 01:08 AM
Entropy digression - by ReneZ - 10-07-2026, 01:17 AM
RE: Entropy digression - by Stefan Wirtz_2 - 10-07-2026, 01:10 PM
RE: Split: Entropy digression - by DG97EEB - 10-07-2026, 01:49 PM
RE: Split: Entropy digression - by eggyk - 10-07-2026, 05:35 PM
RE: Split: Entropy digression - by DG97EEB - 10-07-2026, 11:41 PM
RE: Split: Entropy digression - by ReneZ - 10-07-2026, 11:53 PM
RE: Split: Entropy digression - by Stefan Wirtz_2 - 11-07-2026, 12:14 PM
RE: Split: Entropy digression - by nablator - 11-07-2026, 10:05 AM
RE: Split: Entropy digression - by DG97EEB - 11-07-2026, 10:39 AM
RE: Split: Entropy digression - by ReneZ - 11-07-2026, 11:52 AM
RE: Split: Entropy digression - by nablator - 11-07-2026, 11:58 AM
RE: Split: Entropy digression - by ReneZ - 11-07-2026, 12:02 PM
RE: Split: Entropy digression - by nablator - 11-07-2026, 12:14 PM
RE: Split: Entropy digression - by ReneZ - 11-07-2026, 12:16 PM
RE: Split: Entropy digression - by ReneZ - 11-07-2026, 12:19 PM
RE: Split: Entropy digression - by Stefan Wirtz_2 - 11-07-2026, 12:55 PM

Forum Jump:


Users browsing this thread: