[Blog Post] The 490, and other starting character patterns

[Jorge_Stolfi]

Code:

First_letter_of_a_line counts from RF1b-er.txt Total first_letter_of_a_line character Tokens: 4130 d  640    15.4964%      rf: 0.155 s  624    15.109%      rf: 0.1511 y  610    14.77%        rf: 0.1477 o  544    13.1719%      rf: 0.1317 q  531    12.8571%      rf: 0.1286 ...

OK, so (n-2)P(q)P(o)P(y) = 4128 * 0.129 * 0.132 * 0.148 = ~10.4.

Meaning that, if the line-initial letters had been chosen randomly and independently with those frequencies, in those 4130 lines you should expect to get 10 qoy or thereabouts.  

Also about a dozen dsy, a dozen sdy, a dozen yds, ten qyd, ...

All the best, --jorge