List of "weird" vords

[Mark Knowles]

The problem is one of partitioning the text into two types "filler" text and "real" text. The most repetitive text seems to fit within the "filler" category. The difficulty is drawing the line or clearly making the distinction between the two types of text. Some real language can at times be a little repetitive, so one might have to be careful in not being too strict in distinguishing between the types of text. Obviously if every fifth word was a real word and all the other words were filler it would be easy to distinguish between them, but it seems unlikely that such a simple distinction exists.