29-12-2025, 10:12 AM
(This post was last modified: 29-12-2025, 10:12 AM by Jorge_Stolfi.)
(29-12-2025, 10:05 AM)oshfdk wrote: You are not allowed to view links. Register or Login to view.5.6% of word types or word tokens? Sorry, I haven't been following the discussion closely.
Sorry, all the numbers above are token counts, not word type counts.
I presume that the rejection rate for word types would be much higher, since many rejected words occur only once or a few times. Unless we define the lexicon as being the word types that occur at least N times, where N is, say, 10.
I will try to do this statistic. Please stay tuned...
All the best, --stolfi



![[+]](https://www.voynich.ninja/images/collapse_collapsed.png)