Spaces and Entropy

[Bernd]

Hm, that's quite interesting...
What intrigues me more than the entropy increase by substitution is the increase of h2 by removing spaces.
If I read the graph correctly thats a plus of over 20%, that's massive and much more than in any other document in the text file you shared on the previous page.

I think if we assume a highly verbose cipher we either must treat spaces as nulls to overcome the shortness of vords or alternatively they may separate syllabes / word parts.

Does your transformation destroy the peculiar vord structure with glyphs favoring the beginning / middle / end - or to put it differently - is there a significant difference between glyph combinations within the transformed vords and across spaces?

If we assume spaces are randomly inserted (with a minimum and maximum vord length), there should be no difference across these spaces. But I would assume even after transformation, such would remain, although weaker than in traditional parsings like EVA.