14-09-2019, 05:51 PM
(14-09-2019, 05:35 PM)Anton wrote: You are not allowed to view links. Register or Login to view.As I said yesterday in I don't remember which statistics thread, I think at least 2 orders of magnitude more than the vocabulary size. But, once again, you can explore that by taking a large text of, say, 100000 words, and calculate entropy over a fragment thereof, say, of first 10000 words (note that its vocabulary would probably be less than that of the whole text). Then take a larger fragment of, say, 20000 words. And so on. And observe how the values change.
Okay I'll test this in a bit.
Rene: I redid everything directly copy-pasting from command prompt, so it should be better now. There are still the same high h1-h2 values though.