(10-03-2026, 02:54 PM)Juan_Sali Wrote: You are not allowed to view links. Register or Login to view.Nice tool. I have a request. Is it possible to increase the N-Gram Explorer to size 9?
This size is relevant for my ongoing analisys.
I have been gathering data from You are not allowed to view links. Register or Login to view.. At this point I have enough data
but and aditional source should be great.
Ok, I looked over my code and the N-Gram explorer is one of my oddities. Every other page uses the transcription files themselves. However, the Explorer does not. Instead, I created an entirely new table for it so that it pre-calculates all of the n-grams for every transcription ahead of time. With n-grams limited to 5, that particular db table has around 3.5 million records in it which took a good while to create. Adding n-grams up to 9 would explode that table into another 1.5 - 3 million rows.
I hope you understand, that site already does some massive calculations and isn't all that fast as it is. Adding that much overhead would likely affect every visitor.
(Yesterday, 01:59 AM)Dunsel Wrote: You are not allowed to view links. Register or Login to view.I hope you understand, that site already does some massive calculations and isn't all that fast as it is. Adding that much overhead would likely affect every visitor.
I understand it.
What if you include downloadable csv or txt archives for every non-filtered n-gram size?
In that way some calculations may be avoided (download the archive or write it on your site instead of making the non-filtered calculation every time). And filters of large n-grams can me made apart from your site.
(Yesterday, 02:17 PM)Juan_Sali Wrote: You are not allowed to view links. Register or Login to view. (Yesterday, 01:59 AM)Dunsel Wrote: You are not allowed to view links. Register or Login to view.I hope you understand, that site already does some massive calculations and isn't all that fast as it is. Adding that much overhead would likely affect every visitor.
I understand it.
What if you include downloadable csv or txt archives for every non-filtered n-gram size?
In that way some calculations may be avoided (download the archive or write it on your site instead of making the non-filtered calculation every time). And filters of large n-grams can me made apart from your site.
You are not allowed to view links.
Register or
Login to view.
This should work for you.. If you need anything else just shout.. it's a 30 second job in Lovable..
(Yesterday, 09:07 PM)DG97EEB Wrote: You are not allowed to view links. Register or Login to view.You are not allowed to view links. Register or Login to view.
This should work for you.. If you need anything else just shout.. it's a 30 second job in Lovable..
Thanks, I didnt know this site.
(10 hours ago)Juan_Sali Wrote: You are not allowed to view links. Register or Login to view. (Yesterday, 09:07 PM)DG97EEB Wrote: You are not allowed to view links. Register or Login to view.You are not allowed to view links. Register or Login to view.
This should work for you.. If you need anything else just shout.. it's a 30 second job in Lovable..
Thanks, I didnt know this site.
I've not promoted it widely because I'm building it out to support 2 forthcoming papers, but the main sections are there and available for anyone to use..