(10-03-2019, 08:51 AM)ReneZ wrote: You are not allowed to view links. Register or Login to view.With respect to the question of removing Eva-q:
a great number of words only differ in that they start with qo instead of o .
By removing the q , this distinction is lost and the words become indistinguishable.
This would be a reduction of the entropy.
Hi Rene,
I don't trust my entropy scripts too much, but if I try processing modified EVA as described by Emma I get an increase in conditional entropy:
Unmodified EVA (Takahashi):
Entropy1: 3.8605
Entropy2: 5.7293
Conditional: 1.8688
Initial qo- replaced with o- :
Entropy1: 3.7885
Entropy2: 5.7115
Conditional: 1.9231
Bigram entropy (Entropy2) is nearly identical, likely because q is nearly always followed by o: the presence of q does not bring much bigram information / disorder.
Character entropy (Entropy1) decreases, since replacing qo- causes q- to almost disappear: single characters are easier to guess, since you basically get a smaller alphabet.
The result is that conditional entropy (e2-e1) is higher. There are less different words, but their structure is less predictable.
Does this make sense?
I only consider "inside-word" digraphs (digraphs including space are ignored).