02-08-2021, 10:37 PM
(02-08-2021, 06:11 PM)julian wrote: You are not allowed to view links. Register or Login to view.For Voyn_101 the number will be N for benched and M for un-benched. Will M-N be different or the same for all transcriptions, and will the shapes of the distributions look the same as for EVA?
Yeah, that's basically what I mean. I don't know how easy or time consuming it is for you to repeat the experiment with a different text file? If it's not too much trouble, there is something you could do to remove my worries
And I think the result may be interesting either way.Just make a copy of the EVA file you used and turn a number of n-grams into single characters with find and replace. Since we are only looking at counts, this may even be the same character, like "b".
[ch] -> find and replace with b
[sh] -> b
[ain] -> b
[aiin] -> b
[qo] -> b
Like this, you will have replaced the most annoying n-grams with a single character. If this only changes the absolute values but nothing else, parsing is likely not an issue.

