(16-11-2025, 02:54 PM)ReneZ wrote: You are not allowed to view links. Register or Login to view.The full stops are also unusual and while they may be used in Thai, here they seem to also represent quotes. The character that looks like a tiny dot below some characters is normally not used.
Hi René, I use "." to separate the words. In the original document the "." are spaces.
I don't understand Thai and it could be very well that there are sanscrit words. If you can provide a text, I could give a try.
About the percentages: if we have word "house" and the split is "hou"+"se", the boundary recall is 100%, because there are two splits that match the original word. Of course there are internal splits, but in terms of spaces recall, they are not counted. A 93% of boundary recall means that 7% of the boundaries were not matched (for example, "these houses" could have splitted in "thes" "ehou" "ses", where the middle space is not matched).