sh_ and ch_ compose the same words

[Torsten]

These are the plots for the next four more frequent ch- words vs their sh- counterparts.

Your graphs for the next four more frequent words chol/shol, chor/shor, chey/shey, and cheey/sheey are fantastic. Not only the plot for chol/shol looks similar to the plot of chor/shor, but also the plots for chey/shey and the plot for cheey/sheey. This is not a coincidence. The most frequently used words in Herbal A beside <daiin> are <chol> and <chor>. Moreover, the correlation between <chol> and <chor> is as high as the correlation between <chol> and <shol>. And beside <chol>/<chor> also <shol>/<shor> are frequently used in Herbal A and also for <shol>/<shor> a positive correlation coefficient is computed.

Note: An observation of Currier for chol/chor was: "The symbol groups 'chol' and 'chor' are very high in 'A' and often occur repeated; low in 'B'" (You are not allowed to view links. Register or Login to view.). 

Pearson's Correlation(chol[396] ,shol[186]) : +0.44 (n=225,p=4E-12)
Pearson's Correlation(chor[219] ,shor[97])  : +0.22 (n=225,p=5E-11)
Pearson's Correlation(chol[396] ,chor[219]) : +0.42 (n=225,p=5E-11)
Pearson's Correlation(shol[186] ,shor[97])  : +0.22 (n=225,p=5E-11)

                chol  shol  chor  shor  word count
               ----- ----- ----- ----- -----------
Herbal     (A)   228   104   155    63       8,087
Pharma     (A)    45    11    24     5       2,529
Astro              8           2             2,136
Cosmo             19     8     8     8       2,691
Herbal     (B)    13    11     6     4       3,233
Stars      (B)    62    24    19     9      10,673
Biological (B)    14    18     1     3       6,911

This means we are not observing related word pairs, we are in fact observing networks of four or more similar words.

Per-section correlation also tends to be low, but there are a couple of possibly interesting exceptions, e.g. chey/shey in Stars.

Indeed, the four most frequently used word types starting with 'ch' or 'sh' in the Stars section are <chedy>, <chey>,<shedy>, and <shey>. These four word types also form a network of related words (see You are not allowed to view links. Register or Login to view.).

Pearson's Correlation(chedy[501],shedy[426]): +0.84 (n=225,p=5E-60)
Pearson's Correlation(chey[344] ,shey[283]) : +0.67 (n=225,p=6E-31)
Pearson's Correlation(chedy[501],chey[344]):  +0.71 (n=225,p=6E-36)
Pearson's Correlation(shedy[426],shey[283]):  +0.70 (n=225,p=6E-34)

                chey  shey  chedy  shedy word count
               ----- ----- ------ ------ ----------
Herbal     (A)    55    40      1      0      8,087
Pharma     (A)    21    19      1      1      2,529
Astro              2     7      4      0      2,136
Cosmo             20    16     24     17      2,691
Herbal     (B)    20     6     62     35      3,233
Stars      (B)   123    84    190    113     10,673
Biological (B)    94    99    210    247      6,911

Networks of four similar word types are not untypical for the MS. See for instance You are not allowed to view links. Register or Login to view. as an example for such a network on a single page. These networks mean that beside the direct relation between two ch/sh words also indirect relations might exist. An indirect relation for <chedy>/<shedy> is for instance <chedy> - <chey> - <shey> - <shedy>. In the same way the word <chol> is also related to <chor> via <shol> - <shor>.

These indirect relations also help to understand the correlation coefficient of +0.93 for the word frequencies for all 612 ch/sh word pairs for the whole MS (see posts You are not allowed to view links. Register or Login to view. and You are not allowed to view links. Register or Login to view.).

Pearson's Correlation(count(chWords@VMS),   count(shWords@VMS))   : +0.93 (n=612,p=4E-268)
Pearson's Correlation(count(chWords@folios),count(shWords@folios)): +0.55 (n=225*612=137700,p=too low to calculate)