Split: Entropy digression
#9
(10-07-2026, 11:53 PM)ReneZ wrote: You are not allowed to view links. Register or Login to view.My value was 2.57 with spaces and 2.37 without. We may not have been processing uncertain spaces in the same way.

Without formatting, with all spaces kept (dots and commas converted to spaces) I get 2.58. Close enough. (My web app also converts ends of lines to spaces so there is no need to replace them in voyn_101_bare_UTF8.txt.)

(10-07-2026, 11:53 PM)ReneZ wrote: You are not allowed to view links. Register or Login to view.The v101 file uses 158 different characters, if one counts the space also as a character.

I counted 171 different characters with Notepad++ in voyn_101_bare_UTF8.txt. My web app agrees: h0 = log2(171).

.txt   voyn_101_bare_UTF8.txt (Size: 199.7 KB / Downloads: 5)

Without spaces there is a big discrepancy in h2. I removed all formatting including spaces (dots and commas) and line feeds, converted to UTF-8. (My web app expects UTF-8 when loading drag & dropped files.)

I have:
h1 = 4.181
h2 = 2.954

Can you please check?

.txt   voyn_101_bare_nosp_nolf_UTF8.txt (Size: 155.57 KB / Downloads: 6)

You are not allowed to view links. Register or Login to view.
Reply


Messages In This Thread
Split: Entropy digression - by ReneZ - 08-07-2026, 01:08 AM
Entropy digression - by ReneZ - 10-07-2026, 01:17 AM
RE: Entropy digression - by Stefan Wirtz_2 - 10-07-2026, 01:10 PM
RE: Split: Entropy digression - by DG97EEB - 10-07-2026, 01:49 PM
RE: Split: Entropy digression - by eggyk - 10-07-2026, 05:35 PM
RE: Split: Entropy digression - by DG97EEB - 10-07-2026, 11:41 PM
RE: Split: Entropy digression - by ReneZ - 10-07-2026, 11:53 PM
RE: Split: Entropy digression - by Stefan Wirtz_2 - 11-07-2026, 12:14 PM
RE: Split: Entropy digression - by nablator - 11-07-2026, 10:05 AM
RE: Split: Entropy digression - by DG97EEB - 11-07-2026, 10:39 AM
RE: Split: Entropy digression - by ReneZ - 11-07-2026, 11:52 AM
RE: Split: Entropy digression - by nablator - 11-07-2026, 11:58 AM
RE: Split: Entropy digression - by ReneZ - 11-07-2026, 12:02 PM
RE: Split: Entropy digression - by nablator - 11-07-2026, 12:14 PM
RE: Split: Entropy digression - by ReneZ - 11-07-2026, 12:16 PM
RE: Split: Entropy digression - by ReneZ - 11-07-2026, 12:19 PM
RE: Split: Entropy digression - by Stefan Wirtz_2 - 11-07-2026, 12:55 PM

Forum Jump:


Users browsing this thread: