An Essay on Entropy: what is it, and why is it so important?
#34
(30-04-2022, 06:30 PM)davidjackson wrote: You are not allowed to view links. Register or Login to view.Rule number one when repeating entropy experiments - make sure H0 is always identical!

What do you mean with this, David? I think h0 is a pretty worthless statistic for the types if experiments we are doing. 

Let me demonstrate this with an example. I took a cleaned up full transcription of the VM, it's only got lower case characters and spaces. Over two hundred thousand characters. I then added 49 characters to the end: 1234567890 ABCDEFGHIJKLMNOP&é"'(§è!èçà)-$µù^=:;²= 

(It started out in a structured manner but then I was just pressing random buttons). 

Now normally this addition at the end should not affect the stats much: it's a small nonsense line in a massive text document. And indeed, h1 and h2 hardly change. 

h1 increases with 0.08%
h2 decreases with 0.01%

But h0 increases with 34% !!

H0 might be good to show how much mess there is in your txt file. But h1 and h2 is what you actually need.

Edit: I guess you might mean that when repeating an experiment, an identical h0 should indicate that the same transcription system is used, but this is not reliable. One forgotten upper case letter or punctuation mark and your h0 will change.
Reply


Messages In This Thread
RE: An Essay on Entropy: what is it, and why is it so important? - by Koen G - 30-04-2022, 08:18 PM

Forum Jump:


Users browsing this thread: 3 Guest(s)