26-08-2024, 10:45 PM
(This post was last modified: 27-08-2024, 12:23 AM by RobGea.
Edit Reason: text edit
)
Using Cryptool ngrams on an only-ascii ZL3a-n.txt file shows CH is the Rank No.1 most common bigram in both all_words and distinct words.
That would help towards explaining the graph differences.
Digram Analysis of <ZL2023_Clean.txt>. File size 230559 bytes.
Descending sorted on frequency.
No. Substring Frequency (in %) Frequency
1 CH 7.2458 10865
2 HE 5.4565 8182
3 DY 4.5149 6770
=====================================================================
Digram Analysis of <VMS_distinct_words.txt>. File size 66310 bytes.
Descending sorted on frequency.
No. Substring Frequency (in %) Frequency
1 CH 7.4569 3119
2 HE 4.9298 2062
3 EE 3.6508 1527
That would help towards explaining the graph differences.
Digram Analysis of <ZL2023_Clean.txt>. File size 230559 bytes.
Descending sorted on frequency.
No. Substring Frequency (in %) Frequency
1 CH 7.2458 10865
2 HE 5.4565 8182
3 DY 4.5149 6770
=====================================================================
Digram Analysis of <VMS_distinct_words.txt>. File size 66310 bytes.
Descending sorted on frequency.
No. Substring Frequency (in %) Frequency
1 CH 7.4569 3119
2 HE 4.9298 2062
3 EE 3.6508 1527