Is there any protocols to identify what sort of document MS-408 is?
#26
(17-07-2026, 09:21 AM)Pointless.. wrote: You are not allowed to view links. Register or Login to view.Can we say that a low H0 is not itself evidence of low information content or of non-language? An encoding choice can easily depress symbol-level entropy while keeping the overall information rate of the message completely intact—effectively just redistributing how that entropy is packaged.

Correct, but not just h0.  One can manipulate h1, h2, etc as well.  

However, attempts to compute hk of a 100'000 character text for k greater than 3 or 4 will yield a meaningless number, because there will not be enough data to estimate the required probabilities.

And the entropy does not measure the rate of meaningful information.  It will count the bits of random nulls, spelling errors, and random spelling variations together with those from the meaningful message.

All the best, --stolfi
Reply


Messages In This Thread
RE: Is there any protocols to identify what sort of document MS-408 is? - by Jorge_Stolfi - 17-07-2026, 06:33 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  IMPORTANT ANNOUNCEMENT (well, sort of) Jorge_Stolfi 88 26,529 07-02-2026, 09:03 AM
Last Post: Koen G

Forum Jump:


Users browsing this thread: 1 Guest(s)