(16-01-2023, 01:10 PM)MarcoP wrote: You are not allowed to view links. Register or Login to view.This showed that scrambling increases the rate of reduplication in linguistic texts, but lowers it in the Voynich manuscript.
The fact that scrambling reduces the rate of reduplication in Voynich text seems inevitable. It has a high variety of word types, as seen in its high mid-to-large window MATTR, but an unusually low small-window MATTR. So if you scramble the words, nothing of this small-window behavior will be left. Since the overall word type variation is on the mid-high end, there won't be much coincidental reduplication when the text is scrambled.
The experiment I would like to do is the following:
* Texts to include: a number of different languages and different text types. EVA transliterations. A number of large nonsense texts written by people.
* Make a scrambled version of each text.
* Compare MATTR at various intervals: 5, 10, 20, 50, 100, 200, 500, 1000, 2000, 5000... Maybe by dividing original MATTR by scrambled MATTR. The higher this number is, the more clustered vocabulary is within that window.
* See how Voynichese compares to regular texts and to nonsense texts. For example by plotting them on a logarithmic scale.
Again, the missing ingredient here is lengthy nonsense texts. It would be interesing to see how they behave over longer stretches, and if their MATTR drops off at the same rate as in regular texts.