(17-06-2025, 09:37 PM)nablator wrote: You are not allowed to view links. Register or Login to view.(17-06-2025, 09:27 PM)oshfdk wrote: You are not allowed to view links. Register or Login to view.My question was not about how to do this, but what specific method was used by Prof. Stolfi.
In bencaopinyin.txt:
# Transcription of Chinese characters to pinyin obtained by Google Translate.
So, the Chinese text was transcribed to pinyin and then space separation of pinyin groups was treated as word breaks?

