Heap's Law
#11
I think that with the implied range of its parametric values (which, furthermore, would be language-dependent, as far as I understand), this Heaps law is something too vague to be deemed a "law", or, at least, a "practical law". Moreover, it implies that with the infinite volume of the text the vocabulary would be also infinite, which is simply not true, applied to a natural language, the vocabulary of which is apparently finite.

I would also say that the Heaps law is somewhat excessive, since one can derive the relationship from the Zipf law - but it would not be the Heaps law to which one would arrive.

Consider a text utilizing a vocabulary of D words. If the count of the most frequent word is F, then according to the Zipf law the count of the second most frequent word would be F/2, the count of the third most frequent word would be F/3, et cetera, and the count of the D-th most frequent word (that is, that of the least frequent word) would be F/D. The sum total, which is the volume of the text, would be V = F*(1 + 1/2 + 1/3 + ... + 1/D). What is in brackets is the so-called "harmonic series", the sum of which, under large values of D, is approximated as ln(D) + g, where g is Euler's constant (approximately 0,577). Hence, V = F*[ln(D) + g].

Now, expressing D (vocabulary) through V (volume), we get from this: D = A*exp[V/F], where A is a constant which I introduced for brevity, and A = [exp(-F*g)]^(1/F), which means that A is positive but less than unity.

In contrast to this, Heaps law suggests D = K*V^b, where K and b are positive constants, with K >> 1, and b < 1. The wikipedia article argues that the two laws are "asymptotically equivalent", referring in this to some papers of which full texts are not available for free, so I could not check them, but offhand I can't see how would they be, since a brief check shows me that, with V > F (which of course holds true by definition) and b < 1, A*exp[V/F] grows faster than  K*V^b.
Reply


Messages In This Thread
Heap's Law - by davidjackson - 04-02-2018, 10:22 PM
RE: Heap's Law - by Koen G - 04-02-2018, 10:27 PM
RE: Heap's Law - by Emma May Smith - 04-02-2018, 10:34 PM
RE: Heap's Law - by davidjackson - 04-02-2018, 10:41 PM
RE: Heap's Law - by -JKP- - 04-02-2018, 10:44 PM
RE: Heap's Law - by ReneZ - 05-02-2018, 07:34 AM
RE: Heap's Law - by Koen G - 05-02-2018, 07:52 AM
RE: Heap's Law - by -JKP- - 05-02-2018, 08:02 AM
RE: Heap's Law - by ReneZ - 05-02-2018, 08:48 AM
RE: Heap's Law - by Torsten - 05-02-2018, 10:26 AM
RE: Heap's Law - by Anton - 05-02-2018, 01:56 PM
RE: Heap's Law - by Koen G - 05-02-2018, 03:39 PM
RE: Heap's Law - by ReneZ - 05-02-2018, 04:50 PM
RE: Heap's Law - by davidjackson - 05-02-2018, 06:20 PM
RE: Heap's Law - by DonaldFisk - 06-02-2018, 05:31 AM
RE: Heap's Law - by MarcoP - 05-02-2018, 07:53 PM
RE: Heap's Law - by Anton - 05-02-2018, 07:54 PM
RE: Heap's Law - by ReneZ - 06-02-2018, 06:49 AM
RE: Heap's Law - by Helmut Winkler - 06-02-2018, 11:05 AM
RE: Heap's Law - by MarcoP - 07-02-2018, 01:27 PM
RE: Heap's Law - by Torsten - 07-02-2018, 03:18 PM
RE: Heap's Law - by ReneZ - 07-02-2018, 03:47 PM
RE: Heap's Law - by MarcoP - 07-02-2018, 04:55 PM
RE: Heap's Law - by Torsten - 07-02-2018, 06:14 PM
RE: Heap's Law - by Koen G - 07-02-2018, 03:53 PM
RE: Heap's Law - by davidjackson - 07-02-2018, 11:25 PM
RE: Heap's Law - by Emma May Smith - 08-02-2018, 12:44 AM
RE: Heap's Law - by MarcoP - 08-02-2018, 11:38 AM
RE: Heap's Law - by Anton - 08-02-2018, 11:53 AM
RE: Heap's Law - by davidjackson - 09-02-2018, 06:55 PM
RE: Heap's Law - by MarcoP - 10-02-2018, 11:23 AM
RE: Heap's Law - by davidjackson - 09-02-2018, 06:58 PM
RE: Heap's Law - by Emma May Smith - 09-02-2018, 08:57 PM
RE: Heap's Law - by davidjackson - 09-02-2018, 09:33 PM
RE: Heap's Law - by davidjackson - 10-02-2018, 09:12 PM
RE: Heap's Law - by MarcoP - 11-02-2018, 12:25 PM
RE: Heap's Law - by Torsten - 11-02-2018, 02:21 AM
RE: Heap's Law - by davidjackson - 11-02-2018, 10:34 AM
RE: Heap's Law - by Torsten - 11-02-2018, 12:09 PM
RE: Heap's Law - by davidjackson - 11-02-2018, 12:44 PM
RE: Heap's Law - by MarcoP - 11-02-2018, 02:59 PM
RE: Heap's Law - by Torsten - 11-02-2018, 08:14 PM
RE: Heap's Law - by ReneZ - 11-02-2018, 01:50 PM
RE: Heap's Law - by davidjackson - 12-02-2018, 07:05 PM
RE: Heap's Law - by Torsten - 13-02-2018, 12:57 AM
RE: Heap's Law - by -JKP- - 12-02-2018, 09:47 PM
RE: Heap's Law - by Wladimir D - 13-02-2018, 01:51 PM
RE: Heap's Law - by Koen G - 13-02-2018, 03:02 PM
RE: Heap's Law - by Anton - 13-02-2018, 10:43 PM
RE: Heap's Law - by -JKP- - 14-02-2018, 01:23 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)