Quote:All files were converted to lower case, punctuation and numeric type removed and text normalized to 120 character lines.
Something I forgot to ask, was Hebrew derived from Romanized Hebrew, vowel-Hebrew, or abjadic Hebrew (without points/vowels)?
I was also curious about the source-text for Mandarin. Mandarin is tonal. Depending on how it is transliterated, the tones are sometimes lost, which creates words that are ambiguous and look the same but have different meanings but which might be written differently from one another in other character systems.