I tried the experiment again with 35,000 words per text. Unfortunately I had to drop Timm since the sample I had was c. 10,000. If someone can obtain a 35,000 word sample I'll include it.
Just to make sure I always used the shuffled text as input for the next shuffle, to see if there is an accumulative effect. I don't think this was the case.
Then I wanted to find out what the effect of increased text size was on consistency. I did this by dividing the lowest shuffled h2 for each text by the highest.
For the previous test with 5000 words, this was:
99.6%
99.5%
99.4%
99.5%
99.4%
99.1%
In the current test with 35,000 words, the shuffled h2 values were more consistent, with the lowest value at ca. 99,8% of the highest:
99.9%
99.8%
99.8%
99.8%
It's probably not quite enough yet, but I've reached the limits of the VM text size.
Averaging out the four shuffles for each text, the results are as follows (this should become a table, hope it works):
Rene, how can theoretical max h2 be best taken into account?
Just to make sure I always used the shuffled text as input for the next shuffle, to see if there is an accumulative effect. I don't think this was the case.
Then I wanted to find out what the effect of increased text size was on consistency. I did this by dividing the lowest shuffled h2 for each text by the highest.
For the previous test with 5000 words, this was:
99.6%
99.5%
99.4%
99.5%
99.4%
99.1%
In the current test with 35,000 words, the shuffled h2 values were more consistent, with the lowest value at ca. 99,8% of the highest:
99.9%
99.8%
99.8%
99.8%
It's probably not quite enough yet, but I've reached the limits of the VM text size.
Averaging out the four shuffles for each text, the results are as follows (this should become a table, hope it works):
| text | h0 | h1 | h2 | h2_avg_s | TTR |
| Barlaam | 12.02583167 | 9.329523064 | 4.737718001 | 5.212352078 | 0.119170096 |
| Matthioli | 13.18920683 | 11.21191871 | 3.388789001 | 3.732572534 | 0.267055527 |
| Pliny | 13.62798978 | 11.820678 | 3.029928693 | 3.174719428 | 0.3617142857 |
| VM_TT | 12.89500718 | 10.40921542 | 4.29429829 | 4.461228079 | 0.2176285714 |
Rene, how can theoretical max h2 be best taken into account?