(17-02-2026, 01:46 PM)oshfdk wrote: You are not allowed to view links. Register or Login to view.In a work of fiction this can easily happen if a new character is introduced with a very peculiar foreign sounding name. For example, the below chart shows the number of times "ka" appears in Winnie the Pooh. The first match near the beginning is the chapter index, then there is nothing for half of the book until Roo's mom shows up. But this can happen in non-fiction too, say a history book that doesn't talk about Xerxes until the relevant part of the history is discussed.
And you sir, are exactly why I came to ninja with this. You made me look at something I completely ignored. Thank you!
Now, to address your argument. You are absolutely correct. Adding any proper name with unique bigrams into half a book would produce the same exact results as ed, provided it were used often enough to override other bigrams by count. It definitely would. But, ed is just a bit different.
There are 6 words in the 0ed section that contain ed. And since they only appear once in the entire book, you could easily assume they are proper names. On the other side of that book, ed is in 669 unique words. Of those, 438 are words that only appear once. 231 of those words, keep reappearing. There is a long tail, so many of those words are not used frequently. But others, become core to the vocabulary.
Comparison of unique words and hapax using the bigram ed in the 0ed and ed+ pages.
Frequency count of words in the ed+ pages that contain ed.
Now, if these are true proper names, then chedy is one very busy guy. He appears on almost every single page of the ed+ pages (121 pages) and just over 4 times per page.
So, again, excellent argument but I think I'm going to have to disagree in this case.