29-11-2024, 02:38 PM
(29-11-2024, 01:41 PM)Mauro wrote: You are not allowed to view links. Register or Login to view.Sure I can publish the words lists (and the raw outputs of the various grammar). Now I have them in Excel files, would it be okay if I upload them onto Google? (I ask this because Excel files are often seen with suspicion, they can contain dangerous macros, but there are no macros in those files).
Excel will do, thanks!
I have a question, is my understanding correct that when you quote/compute the coverage you are referring to word type coverage and not word token coverage? I wonder what word token coverage would look like. E.g., from my point of view a grammar that successfully covers 95% of the text tokens by fully incorporating 60% of the most frequent words has more merit than a model covering 95% of words but missing some of the frequent ones. After all, rare words are much more likely to be scribal errors, ambiguous writing, etc.

