25-08-2020, 08:10 AM
This is a really interesting topic, but unfortunately I won't be able to find the time to try this out myself.
Some further thoughts:
- all the shifted characters: A in position 1, A in position 2, A in position 3 etc. etc. are also normal / uncorrelated to all other ones.
- I would have expected that combining the tri-grams would be done by addition of the hypervectors, but the original paper proposes multiplication. The implementation by Darrin seems to use addition, but I remain uncertain whether it actually makes any difference
The correlation is certainly based on multiplication (XNOR as Darrin said)
The main thing that remains open for me in this study is to know more about the higher PCA components.
Some further thoughts:
- all the shifted characters: A in position 1, A in position 2, A in position 3 etc. etc. are also normal / uncorrelated to all other ones.
- I would have expected that combining the tri-grams would be done by addition of the hypervectors, but the original paper proposes multiplication. The implementation by Darrin seems to use addition, but I remain uncertain whether it actually makes any difference
The correlation is certainly based on multiplication (XNOR as Darrin said)
The main thing that remains open for me in this study is to know more about the higher PCA components.