03-03-2016, 11:16 AM
Thanks very much!
The number of repeated sequences in Pliny is certainly less than I was expecting, and the magnitude of our problem has just dropped a bit in my mind :-)
With this small number of repeated sequences, your estimated values should be reasonable. The only problem I see is that of the 55 changed sequences with an 8.5% error rate, there will eventually be more than one change in the same sequence, so one would need a bit higher error rate.
An 8.5% error rate may seem a bit large, but it is worth keeping in mind that there was some process going on in the generation of the text that changed the first word in each line of text. This already accounts for more than 5% 'disturbance' of word sequences.
I don't recall the average nr. of words per line, but it should be less than 20.
The number of repeated sequences in Pliny is certainly less than I was expecting, and the magnitude of our problem has just dropped a bit in my mind :-)
With this small number of repeated sequences, your estimated values should be reasonable. The only problem I see is that of the 55 changed sequences with an 8.5% error rate, there will eventually be more than one change in the same sequence, so one would need a bit higher error rate.
An 8.5% error rate may seem a bit large, but it is worth keeping in mind that there was some process going on in the generation of the text that changed the first word in each line of text. This already accounts for more than 5% 'disturbance' of word sequences.
I don't recall the average nr. of words per line, but it should be less than 20.