The evolution of P/F vs T/K raises important questions

[npcompl33t]

Therefore, in Stars, Herbal-A, and Herbal-B the first word of each parag (and possibly also the next few words) are very likely to be the name of the thing which the parag is about. As such, each of those words is very unlikely to be used again in the same parag.  It may be used a few times in other parags: like, there may be an entry for "black cherry" and another one for "blue cherry", or "true silphium" and "Nigerian silphium"; and a common word like "black" or "fat" may be used in the titles and/or bodies of several entries.

But wouldn't this also be true for the K/T works? The point is that the P words behave differently than the K/T words in the same position. 

On the other hand, after a certain number N1 of tokens, we timidly expect that the word frequencies in the head lines will be similar to those in the rest of the parag, once the gallows are collapsed.

Again, based on your previous plots I would say that, in these three sections, there are three uses of puffs: (1) the first glyph of a parag is very often puffed if it is puffable.  Then (2) 4-8% of the glyphs of the rest of the head line are puffed -- possibly randomly, and only some fraction of the puffable ones.  Then, (3) in Herbal-A and Herbal-B -- but not in Stars -- about 2% of the words in the body get puffed-up.

When you say that something is 'puffed' -- do you mean that a K or T is converted to a P, or that the P is just randomly appended to a line? I guess I'm unclear exactly what your theory is here, sorry if i missed that. 

In fact I have the vague suspicion that "ee" is a "ch" where the ligature was omitted by the Scribe or faded away; or, conversely, "ch" is "ee" with a ligature usually added for clarity.  Anyway, deleting all "e" is a rather drastic hack, that may map words that could be the same (like "keedy" and "kchdy") to different skeletons ("Gdy" and "Gchdy")

this is a good point--the intent here was to try to equalize these words, but if ee = ch then deleting them is actually problematic. And converting ee-ch actually has a pretty significant impact on the way the chart looks,  although the circle removals are unclear. I implemented all of your suggested changes below, and something interesting definitely is happening.  

It doesn't seem to equalize P/F and Ke/Te, and increases the distance between normal P/F and K/T.

In addition, qok/qot words all become far more different. oK/oT words oddly seem mostly unaffected.

Doesn't this seem like these are functioning like different classes of words? It seems odd that these types of substitutions would affect them unequally, right? At the very least, it seems like there are some unknown constraints on which words are 'Puffable'.

   

]I can accept that there may be separable sub-clusters of pages in the Stars section.  Have you seen my post about the sub-section structure of the Shennong Bencao?

 

I have not, can you share that?

Even if it is a different section though, wouldn't you expect P to move similarly to the other gallows words? Why would the P words appear to have different relations from all the gallows words here, even those in the initial line?