{
"cells": [
{
"cell_type": "markdown",
"id": "f5e510a2-9c71-4c17-8106-85eec776003b",
"metadata": {},
"source": [
"# Alignment of the Lakhnawi and Afifi editions\n",
"\n",
"We use our own algorithm for alignment.\n",
"Read the [docs](https://among.github.io/fusus/fusus/align.html) for an extensive discussion of it.\n",
"\n",
"We also tried an existing text-alignment tool, Collatex.\n",
"That attempt was unsuccessful, read more in \n",
"[this notebook](collatexAfLk.ipynb)."
]
},
{
"cell_type": "code",
"execution_count": 1,
"id": "09898308-92d8-4d57-8827-b02799e1a2f0",
"metadata": {},
"outputs": [],
"source": [
"%load_ext autoreload\n",
"%autoreload 2"
]
},
{
"cell_type": "code",
"execution_count": 2,
"id": "1d09fafb-9e3c-4e23-bbf5-b10604d8fe58",
"metadata": {},
"outputs": [],
"source": [
"from fusus.align import Alignment"
]
},
{
"cell_type": "code",
"execution_count": 3,
"id": "970cf095-61a4-4997-b9cd-ffb2f391ba3b",
"metadata": {},
"outputs": [],
"source": [
"ALIGN = Alignment()"
]
},
{
"cell_type": "markdown",
"id": "ae399b04-1d82-4b2e-bb33-3b211958a3fa",
"metadata": {
"tags": []
},
"source": [
"# Load both editions\n",
"\n",
"We use the Text-Fabric versions of the separate LK and AF editions.\n",
"These datasets correspond to the results as generated by the pipelines and then further\n",
"cleaned and enriched by Cornelis.\n",
"\n",
"The process leading to these results is never completely finished, so we maintain versions."
]
},
{
"cell_type": "code",
"execution_count": 4,
"id": "153156ca-2bd5-4503-9a64-472b9685ec1a",
"metadata": {},
"outputs": [],
"source": [
"VERSION = \"0.7\""
]
},
{
"cell_type": "markdown",
"id": "6ed6f0f5-0614-41ee-9b8b-14263d91e506",
"metadata": {},
"source": [
"Finding a good alignment involved a bit of trial and error.\n",
"That involved specifying a few cases where we explicitly tell the algorithm what to do."
]
},
{
"cell_type": "code",
"execution_count": 5,
"id": "4618353b-e212-41f7-b2ca-0308a522d8da",
"metadata": {},
"outputs": [],
"source": [
"CASES = {\n",
" 3072: (3032, 5, 1),\n",
" 4597: (4554, 1, 1),\n",
" 4598: (4555, 1, 1),\n",
" 4600: (4557, 0, 4),\n",
" 8273: (8286, 4, 0),\n",
" 13539: (13529, 2, 1),\n",
" 14878: (14829, 1, 1),\n",
" 14879: (14830, 1, 0),\n",
" 14880: (14830, 12, 0),\n",
" 16198: (16134, 1, 1),\n",
" 16199: (16135, 1, 1),\n",
" 16200: (16136, 1, 1),\n",
" 16201: (16137, 1, 1),\n",
" 16212: (16148, 1, 1),\n",
" 18029: (17970, 6, 1),\n",
" 22762: (22660, 1, 0),\n",
" 22763: (22660, 1, 1),\n",
" 22764: (22661, 1, 1),\n",
"}"
]
},
{
"cell_type": "markdown",
"id": "f1cb5514-e094-4b24-975a-06e5e8df5b1d",
"metadata": {},
"source": [
"We call a function that reads both editions and gives us a handle to all relevant\n",
"information in the alignment process."
]
},
{
"cell_type": "code",
"execution_count": 6,
"id": "d4bb5410-9f72-4e73-9895-b5ff7f195ea7",
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"data: ~/github/among/fusus/tf/Lakhnawi/0.7"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"This is Text-Fabric 9.1.4\n",
"Api reference : https://annotation.github.io/text-fabric/tf/cheatsheet.html\n",
"\n",
"27 features found and 0 ignored\n"
]
},
{
"data": {
"text/html": [
"Text-Fabric: Text-Fabric API 9.1.4, no app configured
Data: among/fusus/tf/Lakhnawi/0.7
Features:
among/fusus/tf/Lakhnawi
boxb
boxl
boxr
boxt
dir
fass
letters
lettersn
lettersp
letterst
ln
lwcvl
n
np
otype
poetrymeter
poetryverse
punc
punca
puncb
puncba
qunawims
quran
raw
title
oslots
Data: among/fusus/tf/Afifi/0.7
Features:
among/fusus/tf/Afifi
b
boxb
boxl
boxr
boxt
confidence
letters
lettersn
lettersp
letterst
ln
n
otype
punc
punca
oslots