31-03-2026, 06:45 PM
(31-03-2026, 03:36 PM)quimqu wrote: You are not allowed to view links. Register or Login to view.....
To test this, I stopped grouping tokens into “families” (that was too unstable) and instead looked only at direct pairs of similar tokens (Levenshtein = 1). Then I compared their contextual profiles. The result is quite strong: tokens that are formally similar have much more similar contexts than expected. Not slightly more. A lot more.
...
Could you explain what you mean by "context"? Sorry if I missed it.