The oddities of the bigram "ed" pt. 4 : The Chunking of Scribes

[Dunsel]

Maybe I'm mistaken, but I think there are a lot of hand 1 pages in the manuscript, quite a number of hand 2 pages and only a few pages each for the rest of the scribes. The first graph appears to look as if the count of chunks is higher for scribe 5 than scribe 1. How is this possible?

Edit: ok, you said "counted and weighted", now I see, however do these absolute values make any sense after counting and weighting?

Weighted as in machine learning scoring:

Code:

Voynich Scribe Chunk Comparison v1 ============================================ Scribe 1: 150 chunks Top 20:   ch        count=1099  pos=middle start=0.3813 mid=0.6115 end=0.0064   iin        count=256    pos=end start=0.0 mid=0.0391 end=0.9609   ol        count=482    pos=end start=0.1577 mid=0.3797 end=0.4606   od        count=407    pos=middle start=0.0713 mid=0.7838 end=0.1425   sh        count=381    pos=middle start=0.4751 mid=0.5013 end=0.021   ee        count=414    pos=middle start=0.0314 mid=0.9565 end=0.0121   ok        count=331    pos=middle start=0.3656 mid=0.6163 end=0.0151   or        count=329    pos=end start=0.0821 mid=0.3161 end=0.5988   cth        count=139    pos=start start=0.5036 mid=0.4676 end=0.0216   ckh        count=115    pos=middle start=0.3217 mid=0.6609 end=0.0174   ot        count=259    pos=middle start=0.4672 mid=0.5097 end=0.0193   che        count=286    pos=middle start=0.3671 mid=0.6294 end=0.0035   ar        count=208    pos=end start=0.0481 mid=0.3125 end=0.6346   aiin      count=194    pos=end start=0.0 mid=0.0464 end=0.9485   al        count=195    pos=end start=0.0462 mid=0.4308 end=0.5179   ai        count=363    pos=middle start=0.0386 mid=0.9587 end=0.0028   cho        count=435    pos=middle start=0.4161 mid=0.5195 end=0.0621   dy        count=265    pos=end start=0.0491 mid=0.0151 end=0.9321   eo        count=433    pos=middle start=0.0023 mid=0.8868 end=0.1109   ey        count=234    pos=end start=0.0 mid=0.0385 end=0.9615 Scribe 2: 150 chunks Top 20:   che        count=266    pos=middle start=0.3759 mid=0.6241 end=0.0   she        count=184    pos=middle start=0.4674 mid=0.5272 end=0.0   dy        count=404    pos=end start=0.0322 mid=0.0223 end=0.9431   ol        count=348    pos=middle start=0.3161 mid=0.3477 end=0.3333   ch        count=551    pos=middle start=0.3793 mid=0.6189 end=0.0   iin        count=112    pos=end start=0.0 mid=0.0357 end=0.9643   qo        count=214    pos=start start=0.9813 mid=0.0047 end=0.0093   ee        count=280    pos=middle start=0.0357 mid=0.95 end=0.0143   al        count=182    pos=end start=0.1044 mid=0.4396 end=0.4505   ar        count=152    pos=end start=0.0724 mid=0.2368 end=0.6842   ckh        count=66    pos=middle start=0.1061 mid=0.8788 end=0.0152   sh        count=292    pos=middle start=0.476 mid=0.5171 end=0.0034   or        count=121    pos=end start=0.1736 mid=0.1653 end=0.6529   ke        count=176    pos=middle start=0.1364 mid=0.8636 end=0.0   cth        count=52    pos=middle start=0.25 mid=0.75 end=0.0   ai        count=186    pos=middle start=0.0484 mid=0.9462 end=0.0054   ey        count=187    pos=end start=0.0 mid=0.0267 end=0.9733   ok        count=182    pos=middle start=0.4451 mid=0.544 end=0.0055   edy        count=205    pos=end start=0.0 mid=0.0195 end=0.9805   aiin      count=85    pos=end start=0.0 mid=0.0235 end=0.9647 Scribe 3: 150 chunks Top 20:   che        count=514    pos=middle start=0.3268 mid=0.6693 end=0.0019   ch        count=1074  pos=middle start=0.3613 mid=0.635 end=0.0028   aii        count=260    pos=middle start=0.0769 mid=0.9231 end=0.0   she        count=216    pos=middle start=0.4444 mid=0.537 end=0.0139   ee        count=617    pos=middle start=0.0146 mid=0.9789 end=0.0065   dy        count=432    pos=end start=0.0162 mid=0.0093 end=0.9722   ol        count=391    pos=end start=0.3095 mid=0.3223 end=0.3657   al        count=392    pos=end start=0.1403 mid=0.4184 end=0.4388   ar        count=339    pos=end start=0.0737 mid=0.236 end=0.6873   ok        count=331    pos=middle start=0.4169 mid=0.574 end=0.0091   ot        count=267    pos=start start=0.5506 mid=0.4419 end=0.0037   sh        count=412    pos=start start=0.5 mid=0.4951 end=0.0049   ai        count=460    pos=middle start=0.0913 mid=0.9087 end=0.0   or        count=197    pos=end start=0.1269 mid=0.198 end=0.6701   aiin      count=189    pos=end start=0.0 mid=0.0106 end=0.9841   ckh        count=75    pos=middle start=0.1467 mid=0.8533 end=0.0   od        count=253    pos=middle start=0.0711 mid=0.8103 end=0.1186   ey        count=267    pos=end start=0.0 mid=0.0225 end=0.9775   ed        count=422    pos=middle start=0.0 mid=0.8957 end=0.1043   eo        count=408    pos=middle start=0.0 mid=0.8529 end=0.1471 Scribe 4: 150 chunks Top 20:   ch        count=505    pos=middle start=0.4792 mid=0.5149 end=0.004   eo        count=291    pos=middle start=0.0069 mid=0.8969 end=0.0962   al        count=247    pos=middle start=0.1174 mid=0.4696 end=0.4089   ot        count=230    pos=start start=0.787 mid=0.2 end=0.0087   ok        count=229    pos=start start=0.6638 mid=0.3319 end=0.0044   ee        count=305    pos=middle start=0.0328 mid=0.9639 end=0.0033   aiin      count=69    pos=end start=0.0145 mid=0.0145 end=0.9565   dy        count=157    pos=end start=0.0064 mid=0.0255 end=0.9618   ol        count=198    pos=middle start=0.1465 mid=0.4899 end=0.3586   sh        count=149    pos=start start=0.6309 mid=0.3624 end=0.0   che        count=193    pos=start start=0.5285 mid=0.4663 end=0.0   ar        count=146    pos=end start=0.089 mid=0.2877 end=0.6164   ey        count=165    pos=end start=0.0 mid=0.0727 end=0.9212   ai        count=156    pos=middle start=0.0833 mid=0.9167 end=0.0   cho        count=150    pos=start start=0.5667 mid=0.38 end=0.0467   or        count=88    pos=end start=0.2045 mid=0.1932 end=0.5909   yk        count=69    pos=start start=0.7971 mid=0.1884 end=0.0145   cth        count=29    pos=middle start=0.2759 mid=0.7241 end=0.0   oke        count=106    pos=start start=0.6509 mid=0.3491 end=0.0   od        count=147    pos=middle start=0.0816 mid=0.8639 end=0.0544 Scribe 5: 118 chunks Top 20:   che        count=84    pos=middle start=0.4048 mid=0.5952 end=0.0   dy        count=119    pos=end start=0.0084 mid=0.0168 end=0.9664   she        count=47    pos=start start=0.6383 mid=0.3404 end=0.0   ch        count=161    pos=middle start=0.4099 mid=0.5839 end=0.0062   ke        count=68    pos=middle start=0.1176 mid=0.8824 end=0.0   ol        count=57    pos=end start=0.1579 mid=0.2807 end=0.5439   qo        count=56    pos=start start=1.0 mid=0.0 end=0.0   aiin      count=20    pos=end start=0.0 mid=0.0 end=0.95   al        count=49    pos=end start=0.102 mid=0.3878 end=0.4898   sh        count=76    pos=start start=0.6579 mid=0.3158 end=0.0132   eo        count=73    pos=middle start=0.0 mid=0.8493 end=0.1507   ar        count=34    pos=end start=0.0 mid=0.2647 end=0.7059   ot        count=45    pos=start start=0.5778 mid=0.4222 end=0.0   ok        count=66    pos=middle start=0.4091 mid=0.5455 end=0.0303   ee        count=66    pos=middle start=0.0 mid=1.0 end=0.0   ai        count=44    pos=middle start=0.0682 mid=0.9318 end=0.0   qok        count=30    pos=start start=0.9667 mid=0.0 end=0.0   cth        count=12    pos=middle start=0.3333 mid=0.6667 end=0.0   ey        count=41    pos=end start=0.0 mid=0.0244 end=0.9756   od        count=55    pos=middle start=0.0545 mid=0.7818 end=0.1455 Total unique chunks across inventories: 266

And yes, there are different page counts for different scribes.  ML weights them based on position and occurrence on a 0-1 scale.  Essentially a percentage.  Yes, Scribe 5 has a lot less content but it's still enough to get a basic score for the chunks.

It was capped at the top 150 'chunks' so Scribe 5 with 118 didn't quite have that many, but still enough to get measuements.