17-11-2025, 01:20 AM
(17-11-2025, 12:10 AM)Jorge_Stolfi wrote: You are not allowed to view links. Register or Login to view.(16-11-2025, 07:34 PM)nablator wrote: You are not allowed to view links. Register or Login to view.Low entropy text is inefficient
But the entropy of Voynichese is not particularly low. The entropy per word, IIRC, is about 10 bits - quite in the normal range.
As for the entropy per character, it depends on the spelling system, not on the language. Iiff yyoouu ssppeellll EEnngglliisshh bbyy ddoouubblliinngg every letter, its entropy per character will drop by half. If instead you insert after each letter a totally random null letter, lower or upper case, the entropy will be halfway between the original value and the max value of 5.7 If you map each letter randomly to upper or lower case, the entropy will increase by 1 bit per character.
In the case of Voynichese, the entropy per character depends on whether one counts each EVA character as a separate letter, or if one considers each of Ch, Sh, ee, iin, etc to be a single letter.
And one must look at higher-order entropy, at least order 3 or 4 for characters.
All the best, --stolfi
Are we allowed to make a thread just talking about the mathematics involved in entropy?
