reading [y] as a null character

[Koen G]

Geoffrey, in case you don't check the blogosphere reader, I published some numbers here: You are not allowed to view links. Register or Login to view.

Removing [y] takes h2 from barely over 3 to 3.20, which is a huge increase. However, as Nick also said, entropy is not useful for detecting nulls. Moreover, while h1 and h2 are now perfectly normal, many other stats are not...