(18-08-2020, 08:34 AM)ReneZ wrote: You are not allowed to view links. Register or Login to view.Then, at the end, when all tri-grams are added, Darrin does this in the 'natural numbers' space, and then converts the result to 0 or 1 depending on whether it is more or less than 'half'.
Yes, and the steps that are described up to this point are perfectly logical and fine, it's just after this last step that the result will not be correct if orthogonal vectors are to be expected from comparing two fully uncorrelated vectors. As it is now, two vectors that are meant to be uncorrelated will give an angle of 60 deg., which (erroneously) shows some correlation.
But if just after having applied the threshold function all '0' are changed to '-1' (and each '1' is left as it is) it should work as intended. (But the correlation will be based on number of exactly matching trigrams according to our known alphabet and the VMS text is just in a transliteration alphabet and is not in our alphabet, but that's another issue).