Why and how the text could be Bavarian
#37
(01-02-2026, 07:48 PM)Rafal wrote: You are not allowed to view links. Register or Login to view.I believe it was shown here on these forums for Latin abbreviations that they actually make the entropy higher.

That should be the case for the character entropy if the bits that are abbreviated are predictable and the abbreviations are systematic and invertible. Like, when one always replaces "-us" by "-9".  That's because (roughly) the word entropy will not change but the average chars per word will decrease, so the average entropy per char will increase.

Otherwise abbreviations may lower the entropy. E.g. if one abbreviates all of "-able" -"eble" "-ible" "-oble" and "-uble" and "-ably" etc. by "-bl" one is actually deleting ~3 bits of information from those tokens, that the reader would have to supply from context or subtle grammatical/lexical info.  The word entropy would be lower; whether the average character entropy is lower or not depends on some arithmetic...

But, again, the character (digraph etc) entropy is not a very useful statistic, because it depends on the spelling system.  The word entropy is more useful, as it is independent of the spelling (provided the same word is spelled the same way most of the time).

And, again, there is no such thing as the "statistics of language X", whether character, word, or anything else.  Such statistics are properties of texts.  

Someone once wrote an entire novel in English (or French, not sure) without using the letter "e" even once.  And AFAIK readers who are not told about it do not notice that big hole in the statistics...

All the best, --stolfi
Reply


Messages In This Thread
RE: Why and how the text could be Bavarian - by Jorge_Stolfi - 01-02-2026, 11:31 PM

Forum Jump:


Users browsing this thread: 6 Guest(s)