15-01-2026, 01:27 PM
(15-01-2026, 10:11 AM)Jorge_Stolfi wrote: You are not allowed to view links. Register or Login to view.(15-01-2026, 09:50 AM)MarcoP wrote: You are not allowed to view links. Register or Login to view.Another interesting detail is: "[a book] made up of the letters MCV, perversely repeated from the first line to the last" - the most dramatic example of a hopelessly meaningless text that has character conditional entropy equal to zero.
To be pedantic, the average character entropy would be about 20/N bits, where N is the length of the book. The 20 bits is a guess at the size of a program that would print out that text, on the Librar'y's Official Turing Machine.
All the best, --stolfi
Should'nt Shannon 1st-order entropy be -3*(1/3*ln(1/3)) =~ 1.099, independent from the length of the book?