03-10-2020, 02:35 AM
(This post was last modified: 03-10-2020, 11:59 PM by Voynichgibberish.)
How rare or not is it for a text of about 34,000 vords or words to have a prefix like You are not allowed to view links. Register or Login to view. which is present for about 15.5% of a corpus?
If any of our researchers were able to scan several different languages like Latin, German, English and lastly Italian would it be common to find a prefix which stands out with such a large foot print in a text like You are not allowed to view links. Register or Login to view.? To be fair if one were to study the statistics for the other various languages they should use only 34,000 words from that text for each language.
I know I'm being a bit bias for the language assumptions to test against, however the VMS was found in Italy so I presume if its not gibberish or it is gibberish in the Zipf presentation of my other thread that it is most likely Latin. However, that being said, if the Author just invented vords and attached them to Latin words maybe the You are not allowed to view links. Register or Login to view. phenomenon is of that reason.
Yet if we do a study and this is common then we all learn that You are not allowed to view links. Register or Login to view. is fine.
Here I am asking again for anyone who has knowledge regarding about how to return or print just the first two characters from words of a text file via python and get a count for those token pairs. As I would like to test this myself, although I'm just a beginner in python, I don't know how to write the code.