Heap's Law

[-JKP-]

Very good idea for a thread.

I don't have time to run tests right now (I wish I did), but I would like to see the statistics for semi-random text.

By that, I mean (as possible examples):

• create a big block of random text that consists only of consonants
  
• now insert vowels at reasonable intervals, as might apply to natural languages
  

Run the stats.

Adjust it so the vowels are at the same intervals as the VMS and run the stats again.


Now try the same essential approach as follows:

• create a big block of random text that consists only of consonants
  
• sort the characters in each token (there are a number of ways this can be done, such as by alphabetical order or by frequency)
  
• now insert vowels at reasonable intervals
  

Run the stats.