"
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"A.table(results, condensed=False)"
]
},
{
"cell_type": "code",
"execution_count": 21,
"metadata": {
"ExecuteTime": {
"end_time": "2018-05-18T09:16:40.841646Z",
"start_time": "2018-05-18T09:16:40.654538Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"result 1"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"result 2"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"result 3"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"A.show(results, end=3, condensed=False)"
]
},
{
"cell_type": "code",
"execution_count": 22,
"metadata": {},
"outputs": [],
"source": [
"A.displayReset()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## All gapped phrases\n",
"\n",
"These were particular gaps.\n",
"Now we want to get *all* gapped phrases.\n",
"\n",
"We can just lift the special requirement that\n",
"the `preGapWord` has to satisfy a special lexical condition."
]
},
{
"cell_type": "code",
"execution_count": 23,
"metadata": {
"ExecuteTime": {
"end_time": "2018-05-24T10:09:32.685437Z",
"start_time": "2018-05-24T10:09:32.680670Z"
}
},
"outputs": [],
"source": [
"query = \"\"\"\n",
"p:phrase\n",
" wPreGap:word\n",
" wLast:word\n",
" :=\n",
"\n",
"wGap:word\n",
"wPreGap <: wGap\n",
"wGap < wLast\n",
"\n",
"p || wGap\n",
"\"\"\""
]
},
{
"cell_type": "code",
"execution_count": 24,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
" 0.91s 716 results\n"
]
}
],
"source": [
"results = A.search(query)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Not too bad! We could wait for it. Here are some results."
]
},
{
"cell_type": "code",
"execution_count": 25,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"| n | p | phrase | word | word | word |
|---|
\n",
"| 5 | Genesis 2:25 | שְׁנֵיהֶם֙ הָֽאָדָ֖ם וְאִשְׁתֹּ֑ו | שְׁנֵיהֶם֙ | אִשְׁתֹּ֑ו | עֲרוּמִּ֔ים |
\n",
"| 6 | Genesis 4:4 | הֶ֨בֶל גַם־ה֛וּא | הֶ֨בֶל | ה֛וּא | הֵבִ֥יא |
\n",
"| 7 | Genesis 7:8 | מִן־הַבְּהֵמָה֙ הַטְּהֹורָ֔ה וּמִן־הַ֨בְּהֵמָ֔ה וּמִ֨ן־הָעֹ֔וף וְכֹ֥ל | בְּהֵמָ֔ה | כֹ֥ל | אֲשֶׁ֥ר |
\n",
"| 8 | Genesis 7:14 | הֵ֜מָּה וְכָל־הַֽחַיָּ֣ה לְמִינָ֗הּ וְכָל־הַבְּהֵמָה֙ לְמִינָ֔הּ וְכָל־הָרֶ֛מֶשׂ לְמִינֵ֑הוּ וְכָל־הָעֹ֣וף לְמִינֵ֔הוּ כֹּ֖ל צִפֹּ֥ור כָּל־כָּנָֽף׃ | רֶ֛מֶשׂ | כָּנָֽף׃ | הָ |
\n",
"| 9 | Genesis 7:21 | כָּל־בָּשָׂ֣ר׀ בָּעֹ֤וף וּבַבְּהֵמָה֙ וּבַ֣חַיָּ֔ה וּבְכָל־הַשֶּׁ֖רֶץ וְכֹ֖ל הָאָדָֽם׃ | בָּשָׂ֣ר׀ | אָדָֽם׃ | הָ |
\n",
"| 10 | Genesis 7:21 | כָּל־בָּשָׂ֣ר׀ בָּעֹ֤וף וּבַבְּהֵמָה֙ וּבַ֣חַיָּ֔ה וּבְכָל־הַשֶּׁ֖רֶץ וְכֹ֖ל הָאָדָֽם׃ | שֶּׁ֖רֶץ | אָדָֽם׃ | הַ |
"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"A.table(results, start=5, end=10)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"If a phrase has multiple gaps, we encounter it multiple times in our results.\n",
"\n",
"We show the two results in Genesis 7:21."
]
},
{
"cell_type": "code",
"execution_count": 49,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"result 9"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"result 10"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"A.show(\n",
" results,\n",
" condensed=False,\n",
" condenseType=\"clause\",\n",
" start=9,\n",
" end=10,\n",
" colorMap={1: \"lightgreen\", 2: \"orange\", 4: \"magenta\"},\n",
")"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"If we want just the phrases, and only once, we can run the query in shallow mode, see [advanced](searchAdvanced.ipynb):"
]
},
{
"cell_type": "code",
"execution_count": 72,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
" 1.08s 672 results\n"
]
}
],
"source": [
"gapQueryResults = A.search(query, shallow=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Excursion\n",
"\n",
"Sometimes there are two subphrases with exactly the same words in it. They only differ in their\n",
"values for the feature `rela`. Let's find such a case.\n",
"\n",
"We do have to show the subphrases, though.\n",
"\n",
"Some types are hidden, let's find out which ones:"
]
},
{
"cell_type": "code",
"execution_count": 53,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"current display options
- baseTypes: {
word} - colorMap: no value
- condenseType:
verse - condensed:
0 - edgeFeatures:
set() - edgeHighlights: no value
- end: no value
extraFeatures:
- fmt:
text-orig-full - forceEdges:
0 - full:
0 hiddenTypes:
clause_atomsentence_atomphrase_atomsubphrasehalf_verse
- hideTypes:
True - highlights:
{} - lineNumbers: no value
- multiFeatures:
0 noneValues:
absentn/anoneunknown- no value
NA
- plainGaps:
True - prettyTypes:
True - queryFeatures:
True - showGraphics: no value
- showMath:
0 - skipCols:
set() - standardFeatures:
0 - start: no value
- suppress:
set() tupleFeatures:
- withLabels:
True - withNodes:
0 - withPassage:
True - withTypes:
0
phrase 1"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"phrase 2"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"phrase 3"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"A.show(\n",
" dResults,\n",
" end=3,\n",
" withNodes=True,\n",
" condensed=True,\n",
" hiddenTypes=\"clause_atom half_verse phrase_atom\",\n",
" condenseType=\"phrase\",\n",
")"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"More research has shown that these subphrases differ in the presence of the `rela` feature."
]
},
{
"cell_type": "code",
"execution_count": 71,
"metadata": {},
"outputs": [
{
"data": {
"text/html": [
"result 1"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"phrase:653102 PP Objc
subphrase:1301306
rela=par
subphrase:1301308
rela=par
result 2"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"phrase:653192 PP Adju
subphrase:1301342
rela=par
subphrase:1301346
rela=par
subphrase:1301345
rela=rec
result 3"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"phrase:653214 NP Objc
subphrase:1301356
rela=adj
subphrase:1301358
rela=par
subphrase:1301360
rela=par
result 1"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"result 2"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"result 3"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"A.show(results, start=1, end=3, condenseType=\"clause\")"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"That looks good.\n",
"\n",
"We can also apply feature conditions to `gapphrase`:"
]
},
{
"cell_type": "code",
"execution_count": 87,
"metadata": {
"ExecuteTime": {
"end_time": "2018-05-24T08:05:41.293060Z",
"start_time": "2018-05-24T08:05:41.237943Z"
}
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
" 0.00s 177 results\n"
]
},
{
"data": {
"text/html": [
"| n | p | phrase |
|---|
\n",
"| 1 | Genesis 2:25 | שְׁנֵיהֶם֙ הָֽאָדָ֖ם וְאִשְׁתֹּ֑ו |
\n",
"| 2 | Genesis 4:4 | הֶ֨בֶל גַם־ה֛וּא |
\n",
"| 3 | Genesis 7:14 | הֵ֜מָּה וְכָל־הַֽחַיָּ֣ה לְמִינָ֗הּ וְכָל־הַבְּהֵמָה֙ לְמִינָ֔הּ וְכָל־הָרֶ֛מֶשׂ לְמִינֵ֑הוּ וְכָל־הָעֹ֣וף לְמִינֵ֔הוּ כֹּ֖ל צִפֹּ֥ור כָּל־כָּנָֽף׃ |
"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"query = \"\"\"\n",
"gapphrase function=Subj\n",
"\"\"\"\n",
"results = A.search(query, sets=customSets)\n",
"A.table(results, start=1, end=3)"
]
},
{
"cell_type": "code",
"execution_count": 88,
"metadata": {
"ExecuteTime": {
"end_time": "2018-05-24T08:05:41.293060Z",
"start_time": "2018-05-24T08:05:41.237943Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"result 1"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"clause WayX NA
phrase CP Conj
function=Conj
phrase VP Pred
function=Pred
phrase NP Subj
function=Subj
phrase AdjP PreC
function=PreC
phrase NP Subj
function=Subj
result 2"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"clause WXQt NA
phrase CP Conj
function=Conj
phrase PrNP Subj
function=Subj
phrase VP Pred
function=Pred
phrase PrNP Subj
function=Subj
phrase PP Cmpl
function=Cmpl
result 3"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"clause Ellp NA
phrase PPrP Subj
function=Subj
clause Ellp NA
phrase PPrP Subj
function=Subj
result 3"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"verse
sentence 17
clause Ellp NA
phrase הֵ֜מָּה וְכָל־הַֽחַיָּ֣ה לְמִינָ֗הּ וְכָל־הַבְּהֵמָה֙ לְמִינָ֔הּ וְכָל־הָרֶ֛מֶשׂ
function=Subj
clause Ptcp Attr
phrase רֹמֵ֥שׂ
function=PreC
phrase עַל־הָאָ֖רֶץ
function=Cmpl
clause Ellp NA
phrase לְמִינֵ֑הוּ וְכָל־הָעֹ֣וף לְמִינֵ֔הוּ כֹּ֖ל צִפֹּ֥ור כָּל־כָּנָֽף׃
function=Subj
result 3"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"verse
sentence 17
clause Ellp NA
phrase PPrP Subj
function=Subj
clause Ptcp Attr
phrase CP Rela
function=Rela
phrase VP PreC
function=PreC
phrase PP Cmpl
function=Cmpl
clause Ellp NA
phrase PPrP Subj
function=Subj
clause:427937 XYqt NA
clause_atom:516082 222
phrase:652703 VP PreO
phrase_atom:905947 יַֽהַרְגֵֽנִי׃
clause:428698 WxQ0 NA
clause_atom:516896 427
phrase:655131 PP Objc
phrase_atom:908524 גַם֩ אֶת־לֹ֨וט
phrase_atom:908525 אָחִ֤יו
phrase_atom:908527 רְכֻשֹׁו֙
phrase:655132 VP Pred
phrase_atom:908528 הֵשִׁ֔יב
phrase:655131 PP Objc
phrase_atom:908530 גַ֥ם אֶת־הַנָּשִׁ֖ים וְאֶת־הָעָֽם׃
clause:428380 Ellp NA
clause_atom:516560 402
phrase:654134 PP Objc
phrase_atom:907449 אֶת־פַּתְרֻסִ֞ים וְאֶת־כַּסְלֻחִ֗ים
clause:428380 Ellp NA
clause_atom:516562 220
phrase:654134 PP Objc
phrase_atom:907455 אֶת־כַּפְתֹּרִֽים׃ ס
| n | p | clause |
|---|
\n",
"| 1 | 1_Kings 8:41 | וְגַם֙ אֶל־הַנָּכְרִ֔י אַתָּ֞ה תִּשְׁמַ֤ע הַשָּׁמַ֨יִם֙ מְכֹ֣ון שִׁבְתֶּ֔ךָ |
"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"result 1"
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"text/html": [
"verse
sentence 92
clause WXYq NA
phrase גַם֙ אֶל־הַנָּכְרִ֔י
clause NmCl Attr
phrase מֵעַמְּךָ֥ יִשְׂרָאֵ֖ל
clause WQt0 Coor
phrase מֵאֶ֥רֶץ רְחֹוקָ֖ה
phrase לְמַ֥עַן שְׁמֶֽךָ׃
verse
sentence 92
clause WXYq NA
phrase הַשָּׁמַ֨יִם֙ מְכֹ֣ון שִׁבְתֶּ֔ךָ
sentence 95
clause xYqX NA
phrase כָּל־עַמֵּ֨י הָאָ֜רֶץ
clause InfC Adju
phrase כְּעַמְּךָ֣ יִשְׂרָאֵ֔ל
clause XQtl Objc
phrase עַל־הַבַּ֥יִת הַזֶּ֖ה
![](\"images/tf-small.png\")
\n",
"![](\"images/etcbc.png\"/)
\n",
"![](\"images/dans-small.png\"/)
\n",
"\n",
"You might want to consider the [start](search.ipynb) of this tutorial.\n",
"\n",
"Short introductions to other TF datasets:\n",
"\n",
"* [Dead Sea Scrolls](https://nbviewer.jupyter.org/github/annotation/tutorials/blob/master/lorentz2020/dss.ipynb),\n",
"* [Old Babylonian Letters](https://nbviewer.jupyter.org/github/annotation/tutorials/blob/master/lorentz2020/oldbabylonian.ipynb),\n",
"or the\n",
"* [Quran](https://nbviewer.jupyter.org/github/annotation/tutorials/blob/master/lorentz2020/quran.ipynb)\n"
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {},
"outputs": [],
"source": [
"%load_ext autoreload\n",
"%autoreload 2"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {
"ExecuteTime": {
"end_time": "2018-05-24T10:06:39.818664Z",
"start_time": "2018-05-24T10:06:39.796588Z"
}
},
"outputs": [],
"source": [
"from tf.app import use"
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {
"ExecuteTime": {
"end_time": "2018-05-24T10:06:48.865143Z",
"start_time": "2018-05-24T10:06:44.712958Z"
}
},
"outputs": [
{
"data": {
"text/markdown": [
"**Locating corpus resources ...**"
],
"text/plain": [
"