16-04-2017, 02:07 PM
@Nick, the candidate groups that you are proposing are not necessary wrong, but the difficulty is the contents of that grouplist.
I made a comparison of the behavior of letters & 2-grams & 3-grams and the outcome is that we can probably form groups, but they are of unequal length and form.
I have now a very nice frequency of the members of these groups. I know from attempts before that comparing them with all the freq. I have of all other languages (new & old) will be fruitless. Let's assume I will not even try that.
>>At the end of all this, (a) there should be a single model, not two or more; and (b) the outbound transition probabilities from each node in the best-fit model should be determined as strongly as possible by the context itself, not by the preceding context.
What do you suggest to do with the "model" now?
I made a comparison of the behavior of letters & 2-grams & 3-grams and the outcome is that we can probably form groups, but they are of unequal length and form.
I have now a very nice frequency of the members of these groups. I know from attempts before that comparing them with all the freq. I have of all other languages (new & old) will be fruitless. Let's assume I will not even try that.
>>At the end of all this, (a) there should be a single model, not two or more; and (b) the outbound transition probabilities from each node in the best-fit model should be determined as strongly as possible by the context itself, not by the preceding context.
What do you suggest to do with the "model" now?