23-04-2024, 12:22 PM
(23-04-2024, 03:51 AM)ReneZ wrote: You are not allowed to view links. Register or Login to view.The details of this first stage are described briefly You are not allowed to view links. Register or Login to view. .Shortcomings in Currier's language identification
A first shortcoming in Currier's identification is that he did not provide a classification for all pages in the MS (4). "Ref-2" (mentioned above) already indicates that the pages not classified by him may possibly represent some intermediate language (or range of languages).
A second more subjective shortcoming is, that some of his criteria are more of a qualitative nature. A more precise criterium to split between his two languages was identified over the years, namely the presence of the bigram ed (Eva: "ed"). This is essentially non-existent in all A-language pages, and very frequent on all B-language pages.
A second more subjective shortcoming is, that some of his criteria are more of a qualitative nature. A more precise criterium to split between his two languages was identified over the years, namely the presence of the bigram ed (Eva: "ed"). This is essentially non-existent in all A-language pages, and very frequent on all B-language pages.
The bigram ed has 5004 matches and the trigram ed9 4151 You are not allowed to view links. Register or Login to view.
The trigram ed9 is mostly ending words, and due to its high frecuenciy it is needed an analisys of larger n-grams including it.
The bigram ed not followed by 9 has 853 matches (5004 - 4151). In terms of analysis of n-gramms this bigram can be mostly splitted to asign both of them to different n-grams, the d is the starting of common trigrams.