KMeans analysis of Currier A, B, C

[Addsamuels]

I like the 3d visualization!

What are the colors and shapes in the 2d plot? EDIT: I now understand that the colors are the clusters and the shapes the Currier classification as A (circle), B (triangle), C/undecided (square). If so, it's clear that PCA1 is basically enough to separate A from B. I don't remember if we were ever able to identify an intuitive meaning for PCA2.



At the bottom of this comment, a similar result (same V-shape) is shown for selected bigrams, rather than the entire set of unique words.



You are not allowed to view links. Register or Login to view.



Colors detailed here: You are not allowed to view links. Register or Login to view.



It's interesting that bigrams show Pharma (yellow) as a partially separated cluster.

Top Words for PCA Component 1 (Main Variation in Folio Texts): shedy: 0.3327 chedy: 0.3215 qokeedy: 0.2618 qokain: 0.2556 qokedy: 0.2362 ol: 0.1917 qokeey: 0.1662 qol: 0.1595 qokaiin: 0.1453 qokal: 0.1430 daiin: -0.1378 chor: -0.1231 chol: -0.1229 otedy: 0.1155 lchedy: 0.1152 cthy: -0.0998 okain: 0.0966 aiin: 0.0943 shey: 0.0919 okedy: 0.0895 qokar: 0.0857 qotedy: 0.0840 ar: 0.0791 chey: 0.0781 okeedy: 0.0780 sho: -0.0777 al: 0.0742 chy: -0.0733 qokey: 0.0732 qoteedy: 0.0714 sheedy: 0.0712 otain: 0.0686 oteedy: 0.0686 chdy: 0.0641 or: 0.0630 qoky: 0.0622 chckhy: 0.0609 ain: 0.0597 okeey: 0.0596 cthor: -0.0592 
Top Words for PCA Component 2 (Second Major Variation in Folio Texts): ar: 0.2653 aiin: 0.2365 daiin: -0.2322 shedy: -0.1937 qokain: -0.1881 al: 0.1773 qol: -0.1606 qokeedy: -0.1519 qokedy: -0.1432 chor: -0.1392 chol: -0.1335 cthy: -0.1329 dain: -0.1291 or: 0.1129 okar: 0.1094 otar: 0.1085 chy: -0.1044 cthor: -0.0932 sho: -0.0922 chdy: 0.0907 air: 0.0897 shol: -0.0889 oteey: 0.0869 ol: -0.0860 shey: -0.0859 qotchy: -0.0838 okal: 0.0836 am: 0.0816 otaiin: 0.0787 shor: -0.0753 shy: -0.0749 oteody: 0.0738 cthol: -0.0717 qokal: -0.0714 qoty: -0.0705 chaiin: -0.0704 lchedy: -0.0666 cheody: 0.0661 oteos: 0.0631 qokeey: -0.0621
CHATGPT Analysis:
Analysis of Top Words for PCA Component 1 and 2
PCA Component 1 (Main Variation in Folio Texts)
This component strongly separates words related to "qokeedy", "qokain", and "shedy" from words like "daiin" and "chor".

1. High Positive Loadings (Strong Contribution to One Side)
   • Words like "shedy" (0.3327), "chedy" (0.3215), "qokeedy" (0.2618), "qokain" (0.2556), and "qokedy" (0.2362) are dominant.
     
   • Many of these words share prefixes "qok-" and "shedy".
     
   • This suggests that folios containing these words are clustered together, likely forming a distinct linguistic or stylistic group.
     
   • The presence of "ol" (0.1917) and "qol" (0.1595) could indicate a second pattern within this cluster.
     
2. Negative Loadings (Opposite Side of the Spectrum)
   • Words like "daiin" (-0.1378), "chor" (-0.1231), and "chol" (-0.1229) push in the opposite direction.
     
   • This indicates that folios dominated by "daiin" and "chor" are distinctly different from those dominated by "shedy" and "qokeedy".
     
   • "cthy" (-0.0998) and "chy" (-0.0733) are also found in the negative range, reinforcing this separation.
     
3. Patterns Noticed
   • The "qok-" prefix is heavily weighted in PCA 1, suggesting a major stylistic or lexical variation in some folios.
     
   • Words ending in "-edy" (shedy, chedy, qokeedy) seem to be characteristic of one category.
     
   • Words with "daiin" and "chor" are defining features of another category.
     

---

PCA Component 2 (Second Major Variation in Folio Texts)
This component captures another variation, possibly a structural or phonetic shift, with vowel-heavy words on one side and consonant-heavy words on the other.

1. High Positive Loadings (One Group of Texts)
   • "ar" (0.2653), "aiin" (0.2365), "al" (0.1773), and "or" (0.1129) dominate this component.
     
   • These words tend to begin with vowels, especially A and O.
     
   • This suggests a separate folio style where vowel-initial words are more common.
     
2. Negative Loadings (Opposing Text Style)
   • "daiin" (-0.2322), "shedy" (-0.1937), "qokain" (-0.1881), "qokeedy" (-0.1519), "chor" (-0.1392) are dominant on this side.
     
   • These words are more consonant-heavy, with strong "qok-" and "shedy" patterns.
     
   • This confirms the trend that "daiin" is in a separate category from vowel-initial words.
     
3. Patterns Noticed
   • PCA 2 separates texts that favor vowel-heavy words ("aiin", "ar", "al") from those using consonant-heavy words ("qokain", "shedy", "chor").
     
   • The negative side is similar to PCA 1's positive side, reinforcing that the "qok-" and "shedy" words are a distinct cluster.
     

---

? Conclusion: What Does This Tell Us?

• PCA 1 is mostly driven by whether a folio contains "qok-" and "shedy" words or "daiin" and "chor" words.
  
• PCA 2 shows a vowel vs. consonant-heavy variation, suggesting another structural difference in the text.