17-03-2026, 01:59 AM
(10-03-2026, 02:54 PM)Juan_Sali Wrote: You are not allowed to view links. Register or Login to view.Nice tool. I have a request. Is it possible to increase the N-Gram Explorer to size 9?
This size is relevant for my ongoing analisys.
I have been gathering data from You are not allowed to view links. Register or Login to view.. At this point I have enough data
but and aditional source should be great.
Ok, I looked over my code and the N-Gram explorer is one of my oddities. Every other page uses the transcription files themselves. However, the Explorer does not. Instead, I created an entirely new table for it so that it pre-calculates all of the n-grams for every transcription ahead of time. With n-grams limited to 5, that particular db table has around 3.5 million records in it which took a good while to create. Adding n-grams up to 9 would explode that table into another 1.5 - 3 million rows.
I hope you understand, that site already does some massive calculations and isn't all that fast as it is. Adding that much overhead would likely affect every visitor.