Updated PCA analysis of various languages
#4
(14-05-2018, 07:32 AM)MarcoP wrote: You are not allowed to view links. Register or Login to view.Thank you, Donald! I think the PCA diagrams provide a useful tool to compare different scripts.
You write that the diagrams can be "rotated or reflected" and mean the same: I guess that a 90 degrees rotation would swap the first and second components, and I am not sure that would be desirable. For instance, in Italian it is the X axis (1st component, I guess) that separates vowels from consonants. But mirroring one or both axis so that the most frequent letter (excluding *) is in a fixed quadrant (e.g. bottom-right) could help the visual comparison.

In your analysis, your write that some of the plots "vaguely resemble the Voynichese plot". It would be great to have a quantitative similarity measure as an indicator of how much two plots are close or different.

Mirroring PCA plots is very easy for me to do and I'll ensure that comparable plots are aligned the same way in future.

Comparing PCA plots is more problematic.   There are standard algorithms for matching points in different 3D scenes but these aren't suitable here.   It's better to identify plausible languages by eye first (see my other post) and then match up the glyphs by trial and error, while ensuring the output texts share properties (ideally, words).   The main concern here is to avoid outputting gibberish.   This is something cryptographers will know more about than me, but I'm interested in adding useful algorithms to my text-processing library.
[+] 1 user says Thank You to DonaldFisk for this post
Reply


Messages In This Thread
RE: Updated PCA analysis of various languages - by DonaldFisk - 29-05-2018, 03:21 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Independent Analysis Identifying Languages Beyond Currier A/ B, compared to René Zand npcompl33t 18 2,647 12-10-2026, 04:10 PM
Last Post: npcompl33t

Forum Jump:


Users browsing this thread: 1 Guest(s)