The evolution of P/F vs T/K raises important questions

[npcompl33t]

An executive summary of your recent plots could be:  

• In all sections, a large fraction of the parags starts with a puff: Pharma ~30%, Herbal-B ~50%, Herbal-A and Stars ~60%, Bio ~70%.
  

Excluding those initials:

• There are no puffs in the first M glyphs of the head lines, where M can be 5 to 10 or more depending on the section.
  
• In Stars, puffs are almost entirely confined to the head lines, where they are ~4% of the glyphs.
  
• In Herbal-A, ~6% of the head line glyphs are puffs, and also ~2% of the body words have puffs.
  
• In Herbal-B head lines, between 4% to 7% of the head line glyphs are puffs, depending on the line length; and also ~2% of the body words have puffs.
  
• In Bio, puffs occur at the same rate in head and body, in about 2-3% of the words.
  
• In Pharma, the head line has about 2 puffs, and the body about one more, independently of the parag's width or length.
  

 
Makes sense?

Yes, thanks for pulling together the threads into one nice summary list. 

Will those gaps remain if all four gallows ptkf are plotted together in the same way?

I think this is the correct next step, I will work on this (i don't have it right now).

However, I wanted to share this. I decided to specifically look at the Stars section.

I wanted to have a better way of answering the question: Are P/F words, or K/T words that are in the paragraph initial lines, similar in construction to K/T words that are not in opening lines.

To do this, I did something like your most recent suggestion. I replaced all characters through the first gallows with G, and i removed e's.

So qokedy, okedy, and kdy all become Gdy. I then pooled all words into the following buckets:

• Opening Line P
  
• Opening line K
  
• Opening like T
  
• K
  
• T
  
• ok
  
• ot
  
• qok
  
• qot
  
• ke
  
• te
  

I then calculated the pairwise JS distance between these transition profiles. Before making the comparison, i adjusted each group according to its internal variance. So this shows distances that remain beyond the internal variance of the groups. 

I know you don't like the golf groups, but I think the stars split is significant, and that we see a register shift in terms of P/F usage between these two stars sections.

   

This is a fascinating comparison, that i think raises several immediate questions about P/F/K/T

In 3c:

• Already we can see that P/F words are more different than k/T words in teh same line, and this difference increases by nearly double against the non-operner gallows variants
  
• we see pretty substantial differences between words containing k/T in opening lines and non opening k/t bearing words. 
  
• Opening K/T are more different from opening P words than non opener K/T, but not by too much.
  
• Ke/te bearing words, even after removing e's are substantially different from all other gallows varaints
   
  

In 4c, the later stars bifolia, we see this picture substantially changes, in a way that is difficult to explain.

• Line opener K/T words now resemble body K/T words. Although K seems to have shifted further than T
  
• Opener P/F words are now substantially more different than every other gallows bearing word
  
• E bearing words are still different from non e bearing, but the distance has shrunk by 50-80% across the board.
  

This is a pretty confusing result. Ke/Te words are substantially different from non-e-bearing versions. Its not as simply as replacing K with Ke, the words have different construction patterns.

If P/F is some combination of K/T words, why do line opener K/T, and most K/T words, get much closer to the non-opener Ke/Te, while paragraph opener P/F move in the opposite direction?

This shift is extremely difficult to explain, and is what i was originally poking at. Here, within the same section, the usage patterns between some groups converge, while P/F appear to diverge more than even before. This seems to indicate the relationships between these words change in different ways, which shouldn't be the case if P/F words are the same as normal K/T varaints.

It's hard to look at these charts and come to the conclusion that P/F words are the same as K/T words.