The oddities of the bigram "ed" pt. 4 : The Chunking of Scribes
#13
(29-05-2026, 03:35 PM)ReneZ wrote: You are not allowed to view links. Register or Login to view.I understand the situation.
If you are using the transliteration files in the IVTFF format, you can get all the information you need from the variables ($I $Q $H etc.) in the page headers.
Among others:
$I gives the illustration type
$Q the quire letter, where A=1 and T=20, and indeed I am skipping 16 and 18.
$H the hand according to Lisa Fagin Davis (1-5)
$B a number for the bibolio/sheet in the quire.
By concatenating the quire letter and the bifolio number, you get a 2-char ID for each sheet.

I started with the original Takahashi years ago it's still my default go-to. And I've downloaded all of the transcriptions from your site.  The problem that I ran into is that having to create multiple parser rules to handle the different tags like <!plant> and <-> and conditional letters meant that every time I wanted to test an idea, the parser had a bunch to chew through.  so, what I did was loaded up every transcription into one big json.  I then wrote a python script that would allow me to select and export any transcription as a single transcription json.  And because I work with just raw text and don't need tags or splats, I have it strip all of those, plus the "." space out so that each line becomes nothing but pure text.  I've been working with json files for years and when doing something like a flat-file, that's about the fastest way to get data into and out of a script without creating a full database... which I've also done in MySQL.  So, I basically use 2 files.  The json transcription and a scribes/quires json so that no matter which transcription I'm using, I can reference sheets, folios, hands, etc.
Reply


Messages In This Thread
RE: The oddities of the bigram "ed" pt. 4 : The Chunking of Scribes - by Dunsel - 29-05-2026, 05:10 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  The oddities of the bigram "ed" Dunsel 45 13,592 17-03-2026, 05:54 AM
Last Post: Dunsel
  The oddities of the bigram "ed" pt. 3 : It's not just "ed" Dunsel 18 5,671 20-02-2026, 08:43 PM
Last Post: Jorge_Stolfi
  The oddities of the bigram "ed" pt. 2: Same as it ever was. Dunsel 16 5,633 18-02-2026, 06:45 PM
Last Post: Jorge_Stolfi

Forum Jump:


Users browsing this thread: 1 Guest(s)