Spaces and Entropy
#9
(03-05-2022, 05:22 PM)Emma May Smith wrote: You are not allowed to view links. Register or Login to view.Did you ever come to a conclusion why the Voynich increase in h2 is bigger than most texts? Or could it simply be that the effect would be larger for texts with a small starting h2?

I think so. It's not an absolute rule, but the general tendency in the corups is that Latin text have little to gain by removing spaces (both in absolute terms and as a percentage). A language like Italian sits somewhere in between, and languages like German and English gain a lot. 

Imagine a text where conditional entropy has been maximized by shuffling everything, including spaces. In this text, removing spaces will have a small effect on h2. The VM almost sits at the other end. Some very predictable pairs are removed if you take out spaces. Granted, these will be replaced by other predictable pairs in places where common final and common initial glyphs meet. But there will be more variation overall.

Note that in unmodified EVA, Voynichese's gains were just a bit above the mean. I think this is because of the aforementioned scenario, where omitting spaces creates novel common pairs, like [nc, nq, ns]... These in turn will keep h2 low

In fact, if we look at the absolute increase in h2 (rather than a percentage), EVA's gains are below the mean.
[+] 1 user says Thank You to Koen G for this post
Reply


Messages In This Thread
Spaces and Entropy - by Koen G - 03-05-2022, 02:01 PM
RE: Spaces and Entropy - by Ruby Novacna - 03-05-2022, 02:17 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 02:21 PM
RE: Spaces and Entropy - by Ruby Novacna - 03-05-2022, 02:42 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 02:56 PM
RE: Spaces and Entropy - by Ruby Novacna - 03-05-2022, 04:10 PM
RE: Spaces and Entropy - by Emma May Smith - 03-05-2022, 05:22 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 06:04 PM
RE: Spaces and Entropy - by Bernd - 03-05-2022, 05:49 PM
RE: Spaces and Entropy - by Juan_Sali - 03-05-2022, 06:25 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 06:25 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 06:39 PM
RE: Spaces and Entropy - by davidjackson - 03-05-2022, 07:19 PM
RE: Spaces and Entropy - by Emma May Smith - 03-05-2022, 11:11 PM
RE: Spaces and Entropy - by Ruby Novacna - 03-05-2022, 11:24 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 11:35 PM
RE: Spaces and Entropy - by Emma May Smith - 04-05-2022, 01:19 AM
RE: Spaces and Entropy - by ReneZ - 04-05-2022, 05:16 AM
RE: Spaces and Entropy - by Bernd - 04-05-2022, 12:22 PM
RE: Spaces and Entropy - by Koen G - 04-05-2022, 01:32 PM
RE: Spaces and Entropy - by MichelleL11 - 04-05-2022, 04:19 PM
RE: Spaces and Entropy - by Bernd - 05-05-2022, 11:27 AM
RE: Spaces and Entropy - by Koen G - 04-05-2022, 04:44 PM
RE: Spaces and Entropy - by ReneZ - 04-05-2022, 06:00 PM
RE: Spaces and Entropy - by Koen G - 04-05-2022, 06:26 PM
RE: Spaces and Entropy - by ReneZ - 05-05-2022, 06:11 PM
RE: Spaces and Entropy - by cvetkakocj@rogers.com - 05-05-2022, 05:17 PM
RE: Spaces and Entropy - by Searcher - 07-05-2022, 02:38 PM
RE: Spaces and Entropy - by Koen G - 20-05-2022, 10:45 AM
RE: Spaces and Entropy - by Bernd - 20-05-2022, 02:22 PM
RE: Spaces and Entropy - by Koen G - 20-05-2022, 03:59 PM
RE: Spaces and Entropy - by Searcher - 20-05-2022, 04:10 PM
RE: Spaces and Entropy - by Anton - 22-05-2022, 12:28 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Confirmation that spaces are really spaces quimqu 34 13,809 21-11-2025, 08:44 AM
Last Post: ReneZ

Forum Jump:


Users browsing this thread: 2 Guest(s)