16-03-2026, 11:44 PM
(16-03-2026, 05:55 PM)quimqu wrote: You are not allowed to view links. Register or Login to view.4. Regarding René's question: René was asking if the “core word” tends to be more frequent than the variants.
In this study, I defined the core of the burst as the first word that appears in the sequence, because the goal is to see if the variants are generated from previous words in the text flow. Defining the core as the medoid (the word with the smallest total distance to the set), for example, completely eliminates directionality and is therefore not suitable for this type of question.
With this definition the results are:
Number of bursts analyzed: 3774
average frequency of the core ≈ 6
average frequency of the variants ≈ 70
Only approximately between 5% and 10% of the bursts have a core that is more frequent than its members.
That is, on average the variants are much more frequent than the initial word of the burst.
That is perhaps unexpected, and raises the question: what is the reason that the variant word appeared at that point?
Was it because it is a variant of a previous core word?
Or was it because it is a relatively frequent word that is therefore likely to appear anyway?
The latter has to be the preferred case.
(or the text is backwards...)