Spaces and Entropy
#16
When I was corresponding with Marco about this, I remember we agreed how difficult it is to predict entropy behavior. There are just so many variables.

Take your example. Imagine a situation where "o" can be followed by a wide range of glyphs. Now, after your proposed transformation, it can only be followed by two glyphs. (Although now those two glyphs can be followed by everything that could originally follow "o", so you get a bunch of new combinations there).

So it's really hard to predict, but I would guess that in the majority of cases you'd be correct: splitting a glyph will normally increase the number of possible combinations and hence increase h2. I'll try to test this tomorrow, although I'm not sure yet how to replace half of all o's randomly. Humans are bad at random so it would have to be automated somehow. It would be the random (unconditional) selection that increases conditional entropy.

In a way, "splitting glyphs" is a method VM translators may use to add entropy back into the mix, for example by choosing whether to translate a glyph as "t" or "d". If this selection happens at the whim of the translator, it is not conditioned by surrounding glyphs so it will increase h2.

Edit: I must add that it is the same mechanism that eventually leads to one-way cipher solutions, because it would imply that a lot of information was lost upon incryption.
Reply


Messages In This Thread
Spaces and Entropy - by Koen G - 03-05-2022, 02:01 PM
RE: Spaces and Entropy - by Ruby Novacna - 03-05-2022, 02:17 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 02:21 PM
RE: Spaces and Entropy - by Ruby Novacna - 03-05-2022, 02:42 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 02:56 PM
RE: Spaces and Entropy - by Ruby Novacna - 03-05-2022, 04:10 PM
RE: Spaces and Entropy - by Emma May Smith - 03-05-2022, 05:22 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 06:04 PM
RE: Spaces and Entropy - by Bernd - 03-05-2022, 05:49 PM
RE: Spaces and Entropy - by Juan_Sali - 03-05-2022, 06:25 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 06:25 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 06:39 PM
RE: Spaces and Entropy - by davidjackson - 03-05-2022, 07:19 PM
RE: Spaces and Entropy - by Emma May Smith - 03-05-2022, 11:11 PM
RE: Spaces and Entropy - by Ruby Novacna - 03-05-2022, 11:24 PM
RE: Spaces and Entropy - by Koen G - 03-05-2022, 11:35 PM
RE: Spaces and Entropy - by Emma May Smith - 04-05-2022, 01:19 AM
RE: Spaces and Entropy - by ReneZ - 04-05-2022, 05:16 AM
RE: Spaces and Entropy - by Bernd - 04-05-2022, 12:22 PM
RE: Spaces and Entropy - by Koen G - 04-05-2022, 01:32 PM
RE: Spaces and Entropy - by MichelleL11 - 04-05-2022, 04:19 PM
RE: Spaces and Entropy - by Bernd - 05-05-2022, 11:27 AM
RE: Spaces and Entropy - by Koen G - 04-05-2022, 04:44 PM
RE: Spaces and Entropy - by ReneZ - 04-05-2022, 06:00 PM
RE: Spaces and Entropy - by Koen G - 04-05-2022, 06:26 PM
RE: Spaces and Entropy - by ReneZ - 05-05-2022, 06:11 PM
RE: Spaces and Entropy - by cvetkakocj@rogers.com - 05-05-2022, 05:17 PM
RE: Spaces and Entropy - by Searcher - 07-05-2022, 02:38 PM
RE: Spaces and Entropy - by Koen G - 20-05-2022, 10:45 AM
RE: Spaces and Entropy - by Bernd - 20-05-2022, 02:22 PM
RE: Spaces and Entropy - by Koen G - 20-05-2022, 03:59 PM
RE: Spaces and Entropy - by Searcher - 20-05-2022, 04:10 PM
RE: Spaces and Entropy - by Anton - 22-05-2022, 12:28 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Confirmation that spaces are really spaces quimqu 34 13,809 21-11-2025, 08:44 AM
Last Post: ReneZ

Forum Jump:


Users browsing this thread: 2 Guest(s)