Aga, it's quite easy to take individual tokens and small sections of text and turn them into words. It can be done in many languages.
But if the system doesn't work on the tokens before and after... and if the letter-frequency is very different from whatever language you are using, then it might simply be a coincidence that some of the letters match words. You have to do it with a larger chunk of text to see if it actually works.
But if the system doesn't work on the tokens before and after... and if the letter-frequency is very different from whatever language you are using, then it might simply be a coincidence that some of the letters match words. You have to do it with a larger chunk of text to see if it actually works.