(22-08-2020, 05:54 PM)dvallis wrote: You are not allowed to view links. Register or Login to view.If enough trigrams are similar the language vectors will be -mathematically- similar.
Darrin, I hope you don't think I'm being too picky, but what you really wan't to (or should) say is 'if enough trigrams are the same', not 'similar'. I.e. they are only matched and contribute to the total correlation when all three characters in the trigram are exactly matched. I think it's important to make that distinction. It's the number of these exactly matching trigrams that are counted and which will determine the outcome. And if they are not matched, the vectors of the two trigrams will be as orthogonal (fully uncorrelated) as the rest.