About the generation of similar words

[quimqu]

Based on one of the results of the last analysis, the fact that a large part of the insertions and deletions are concentrated at the beginning of the token, I wanted to check if this could be an artifact of the internal direction of the word. In many natural languages such as Catalan, Spanish, French or German, morphological variation is loaded more often at the end of the word than at the beginning. This made me think of testing a simple hypothesis: maintain the position of the words in the text, but internally invert each token, as if they were written from right to left.

I have done the test keeping exactly the same parent-child relationship detection model and the same metrics. The result is quite clear. The quality of the model gets slightly worse when the tokens are reversed: the average distance increases and the exact copy ratio decreases. The transformation rules do not become simpler or more regular. The concentration of repeated rules does not improve and the distribution of the change positions remains scattered, without a cleaner structure appearing at the end of the token.

In the original version, the father is more or equally frequent than the son in about 75% of the relationships, and this pattern remains stable. With internal inversion, not only does it not improve, but it loses consistency in some cases. Nor is there any clear reorganization of insertions and deletions towards the relative end of the word, which would be what we would expect if we were reading the tokens backwards.

Therefore, reversing the internal order of the words does not explain the data better. This reinforces the idea that the text generation mechanism works preferentially on the beginning of words, and not on the end as would be more common in natural language.