A family of grammars for Voynichese

[Jorge_Stolfi]

5.6% of word types or word tokens?

Here are the numbers for word types (as opposed to tokens).  For these statistics I defined the lexicon of a text as being the set of words that occur at least 3 times.   The column "vlex" is the number of word types in each subset that occur at least 3 times and uses only "valid" EVA chars (excluding '?', weirdos, and [bgjuvwxz]).  The column "vgud" is the number of those words that fit the crust-mantle-core (CMC) model as defined before.  "vbad" is the number that violate that model, and %gud is the percentage of "vgud" over "vlex".

LEXICON SIZES WITH VALID CMC STRUCTURE
   
    sec-type    vlex  vgud  vbad    %gud
    ----------- ----- ----- ----- ------
    bio-parags  295    295    0   100.00
    cos-parags   56     56    0   100.00
    hea-parags  407    404    3    99.26
    heb-parags  210    209    1    99.52
    pha-parags  150    149    1    99.33
    str-parags  546    541    5    99.08
    unk-parags  205    205    0   100.00

    tot-parags 1361   1328   33    97.58

That is, 97.58% of the word types that use only valid EVA characters fit the CMC model.

The numbers for "tot-parags" are bigger than the sum of the section numbers  because a word that occurs (say) once in one section and 2 times in another will not be in the lexicons of those sections, but will be in the lexicon of the whole parags text.

These are the 33 word types (with at least 3 occurrences) that do not fit the CMC model, and their occurrence counts in the total parags text:

    7.0 daiidy     Should be valid?
    7.0 polchedy   Two words?
    6.0 aithy      Uses the {ith} non-element.
    5.5 cholky     Two words?
    4.5 ail        Should be valid?
    4.5 cholkaiin  Two words?
    4.0 cheeteey   Has 3 benches.
    4.0 chodchy    Two words?
    4.0 cholkar    Two words?
    4.0 cholkeedy  Two words?
    4.0 dairal     Two words, {d}{a}{ir}.{a}{l}?
    4.0 dairin     Ditto?
    4.0 ety        Should be valid?
    4.0 qoedy      Should be valid?
    4.0 qoeol      Should be valid?
    4.0 shoikhy    Uses the {ikh} non-element.
    3.5 pchocthy   Two gallows; two words?
    3.0 aiinal     Two words, {a}{in}.{a}{l}?
    3.0 aikhy      Uses the {ikh} non-element.
    3.0 airody     Two words, {a}{ir}.{o}{d}{y}?
    3.0 airol      Two words, {a}{ir}.{o}{l}?
    3.0 cheolkain  Two words?
    3.0 cholchedy  Two words?
    3.0 chsey      The {se} is {sh} perhaps?
    3.0 chsky      Two words?
    3.0 dairody    Two words, {d}{a}{ir}.{o}{d}{y}?
    3.0 daldaiin   Two words, {d}{a}{d}.{d}{a}{iin}?
    3.0 oikhy      Uses the {ikh} non-element.
    3.0 polshy     Two words?
    3.0 qekchdy    Should be valid?
    3.0 qoedaiin   Should be valid?
    3.0 sheekchy   Has 3 benches.
    3.0 tockhy     Has 2 gallows; two words?

All the best, --stolfi