16-11-2025, 06:10 AM
(16-11-2025, 04:22 AM)Dunsel wrote: You are not allowed to view links. Register or Login to view.Voynich words peak sharply at 5–6 glyphs, with a long but low-frequency tail.
That "long-frequency tail" is probably transcription errors, where multiple words are strung together. Hunt them down and check with the page images.
You seem to be computing the length distribution of tokens (word ocurrences). Try instead that of lexemes ("word types").
Be sure to map everything to lowercase.
For a double surprise, try also Chinese or Vietnamese...
All the best, --stolfi