12-05-2025, 04:35 PM
So it's like if you put all the letters (tokens) in the MS in a big bag and draw them at random, what are your chances of drawing "g", and then this is compared to the actually occurrence of "g" before and after your prompt?
I see how this is very useful and instructive in most cases, but like you say, the small numbers cause counterintuitive results. That is to say, from the perspective of "g" it might be interesting that it occurs twice after "ld". But in the story of "ld", the "g" doesn't really matter. In its ca. 450 occurrences, it only accounts for a tiny percentage.
I see how this is very useful and instructive in most cases, but like you say, the small numbers cause counterintuitive results. That is to say, from the perspective of "g" it might be interesting that it occurs twice after "ld". But in the story of "ld", the "g" doesn't really matter. In its ca. 450 occurrences, it only accounts for a tiny percentage.