25-09-2025, 12:52 PM
(25-09-2025, 12:40 PM)Mauro wrote: You are not allowed to view links. Register or Login to view.I made a test with De Bello Gallico: it has 11030 word types, of which 6314 are hapax legomena. The whole text is 51503 words long, so most of the text (88%) would be culled by your procedure, but only ~43% of the vocabulary.
I understood that Mark considers deleting words that are repeated in consecutive positions.

