{
"cells": [
{
"cell_type": "markdown",
"metadata": {
"id": "I08sFJYCxR0Z"
},
"source": [
""
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "FwJ-P56kq6FU"
},
"source": [
"[](https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/legal-nlp/01.Page_Splitting.ipynb)"
]
},
{
"cell_type": "markdown",
"metadata": {
"collapsed": false,
"id": "gk3kZHmNj51v"
},
"source": [
"#๐ฌ Installation"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "_914itZsj51v",
"pycharm": {
"is_executing": true
}
},
"outputs": [],
"source": [
"! pip install -q johnsnowlabs"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "YPsbAnNoPt0Z"
},
"source": [
"##๐ Automatic Installation\n",
"Using my.johnsnowlabs.com SSO"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "fY0lcShkj51w",
"pycharm": {
"is_executing": true
}
},
"outputs": [],
"source": [
"from johnsnowlabs import nlp, legal\n",
"\n",
"# nlp.install(force_browser=True)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "hsJvn_WWM2GL"
},
"source": [
"##๐ Manual downloading\n",
"If you are not registered in my.johnsnowlabs.com, you received a license via e-email or you are using Safari, you may need to do a manual update of the license.\n",
"\n",
"- Go to my.johnsnowlabs.com\n",
"- Download your license\n",
"- Upload it using the following command"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "i57QV3-_P2sQ"
},
"outputs": [],
"source": [
"from google.colab import files\n",
"print('Please Upload your John Snow Labs License using the button below')\n",
"license_keys = files.upload()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "xGgNdFzZP_hQ"
},
"source": [
"- Install it"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "OfmmPqknP4rR"
},
"outputs": [],
"source": [
"nlp.install()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "DCl5ErZkNNLk"
},
"source": [
"#๐ Starting"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "wRXTnNl3j51w",
"colab": {
"base_uri": "https://localhost:8080/"
},
"outputId": "3b5b58ac-23a4-45ca-80a0-eebd33519841"
},
"outputs": [
{
"output_type": "stream",
"name": "stdout",
"text": [
"๐ Detected license file /content/4.3.0.spark_nlp_for_healthcare-2.json\n",
"๐ Launched \u001b[92mcpu optimized\u001b[39m session with with: ๐Spark-NLP==4.3.0, ๐Spark-Healthcare==4.3.0, running on โก PySpark==3.1.2\n"
]
}
],
"source": [
"spark = nlp.start()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "nWu_IMfY4L1N"
},
"source": [
"#๐ Legal Text Splitting"
]
},
{
"cell_type": "markdown",
"metadata": {
"collapsed": false,
"id": "PV_iiuN13pqt"
},
"source": [
"๐Text splitting is very important for many reasons.\n",
"\n",
"- Legal documents may be **very long** (contracts, agreements, etc) and applying AI to the whole document may take much time.\n",
"- Most Language Models have **token restrictions**. For example, Bert-based models can only process up to 512 tokens, while our biggest LM (Longformers) can process up to 4096 (but affecting negatively to the performance).\n",
"- If you have models which do specific extractions on **specific sections**, it does not make sense you run them over the whole document: you may get a lot of False Positives.\n",
"\n",
"But also:\n",
"- Language Models will only \"understand\" only that **portion of text you send to them**. If you send *little information*, they may be biased and take wrong decisions.\n",
"- On the other hand, sometimes sending *too much information* makes the information get deluded or add noise.\n",
"\n",
"And!\n",
"- Make sure the tokenization and splitting mechanism is the same in training and inference, or you will get undesirable results.\n",
"\n",
"Because of these reasons, the very first thing you need to think about is how to properly split your texts, depending on the kind of task you want to carry out.\n",
"\n",
"\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"collapsed": false,
"id": "epYpe7GR3pqt"
},
"source": [
"#๐ 1. Text Classification"
]
},
{
"cell_type": "markdown",
"metadata": {
"collapsed": false,
"id": "Z74afIDs3pqu"
},
"source": [
"#โ๏ธ 1.1. Background\n",
"Text classification is the NLP task in charge of retrieving a `category` based on a piece of text you send to the model. A good example of it it's `Clause identification` in legal contracts.\n",
"\n",
"There are several ways we can carry out Text Classification:\n",
"\n",
"- `At a whole-text level (no splitting)`: That's not feasible for most legal documents. As we already know, we have token restrictions (512 for most BERT-based thansformers). We can use Longformers (4096), but in most cases, documents as Legal Agreements have much more than that, what will go for sure beyond any limitation.\n",
"\n",
"- `Retrieving first page`: In most cases, the relevant information of a document is in the first page. Just by splitting by pages and retrieving the first one, you can do text classification. \n",
"\n",
"- `Using Legal NLP TextSplitter`: `TextSplitter` is an NLP annotator that it's meant to split documents into sentences, but is pretty customisable to retrieve **paragraphs or setions** as well.\n",
"\n",
"- `At paragraph, section or sentence level using NER` for detecting headers and `ChunkSentenceSplitter`\n",
"\n",
"The way you split may totally change the results you are getting. Let's see an example."
]
},
{
"cell_type": "markdown",
"metadata": {
"collapsed": false,
"id": "LoefU3za3pqu"
},
"source": [
"#โ๏ธ 1.2. Page splitting"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "yL-ycp_g6SLc"
},
"source": [
"Sometimes, pages have patterns which tell you how to split them. In our case, `the page number` was present in the bottom of our documents.\n",
"\n",
"Feel free to always analyze for signals when trying to detect pages boundaries. Patterns you can usually find in the bottom of a page:\n",
"- Bottom placeholders\n",
"- Name of people\n",
"- Name of the document\n",
"- etc."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "AA5f5-T13pqw"
},
"outputs": [],
"source": [
"document_assembler = nlp.DocumentAssembler() \\\n",
" .setInputCol(\"text\") \\\n",
" .setOutputCol(\"document\")\n",
"\n",
"text_splitter = legal.TextSplitter() \\\n",
" .setInputCols([\"document\"]) \\\n",
" .setOutputCol(\"pages\")\\\n",
" .setCustomBounds([\"\\n+\\s*[0-9]+\\s*\\n+\"])\\\n",
" .setUseCustomBoundsOnly(True)\\\n",
" .setExplodeSentences(True)\n",
"\n",
"nlp_pipeline = nlp.Pipeline(stages=[\n",
" document_assembler,\n",
" text_splitter])"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "9b1OGUnn7atc"
},
"source": [
"๐Explanation:\n",
"- `.setCustomBounds([\"\\n+\\s+[0-9]\\n+\"])` sets an array of regular expression(s) to tell the annotator how to split the document.\n",
"- `.setUseCustomBoundsOnly(True)` the default behaviour of TextSplitter is Text Splitting, so we set to ignore the default regex ('\\n', ...).\n",
"- `.setExplodeSentences(True)` creates one new row in the dataframe per split."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "SZVLnu3j6Rsk"
},
"source": [
"\n",
"Let's download a document and use `whole-text` classifiers."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "EK6jVBnf3pqv"
},
"outputs": [],
"source": [
"import requests\n",
"URL = \"https://raw.githubusercontent.com/JohnSnowLabs/spark-nlp-workshop/master/legal-nlp/data/credit_agreement.txt\"\n",
"response = requests.get(URL)\n",
"\n",
"credit_agreement = response.content.decode('utf-8')"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "NGVrZmta6xmr"
},
"source": [
"Let's apply our page splitter."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "oZtnquVx65Ic"
},
"source": [
"## Using Fit/Transform (all the dataframe will be processed in paralel using all the spark cluster nodes)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "qmqE7OKZ60O2"
},
"outputs": [],
"source": [
"#fit: trains, configures and prepares the pipeline for inference. \n",
"\n",
"sdf = spark.createDataFrame([[ credit_agreement ]]).toDF(\"text\")\n",
"\n",
"fit = nlp_pipeline.fit(sdf)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "Fkbj6SAV8d8c",
"outputId": "e5f7180f-6445-4223-e951-2f75809cbf89"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+--------------------+\n",
"| pages|\n",
"+--------------------+\n",
"|[{document, 70, 3...|\n",
"|[{document, 31821...|\n",
"|[{document, 34560...|\n",
"|[{document, 37458...|\n",
"|[{document, 40734...|\n",
"|[{document, 43945...|\n",
"|[{document, 46511...|\n",
"|[{document, 49420...|\n",
"|[{document, 53065...|\n",
"|[{document, 56539...|\n",
"|[{document, 59694...|\n",
"|[{document, 62708...|\n",
"|[{document, 65372...|\n",
"|[{document, 69079...|\n",
"|[{document, 71565...|\n",
"|[{document, 74775...|\n",
"|[{document, 77563...|\n",
"|[{document, 80027...|\n",
"|[{document, 82912...|\n",
"|[{document, 85983...|\n",
"+--------------------+\n",
"only showing top 20 rows\n",
"\n",
"CPU times: user 83.3 ms, sys: 9.21 ms, total: 92.5 ms\n",
"Wall time: 11.4 s\n"
]
}
],
"source": [
"%%time\n",
"\n",
"#transforms: executes inference on a fit pipeline\n",
"res = fit.transform(sdf)\n",
"\n",
"res.select('pages').show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "vf6Kn9VM756V"
},
"source": [
"## Using LightPipelines (everything will be executed in 1 node. It's much quicker for small dataframes, but does not leverage the cluster capacities)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "bo2sw-xK75NH"
},
"outputs": [],
"source": [
"%%time\n",
"import json\n",
"lp = nlp.LightPipeline(fit)\n",
"\n",
"json_res = lp.annotate(credit_agreement)\n",
"\n",
"print(json.dumps(json_res, indent=4))"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "ROJv5GzS-Uq6"
},
"outputs": [],
"source": [
"pages = [json_res['pages'][i] for i in range(0,10)]"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "pulFvNWc8_M8"
},
"source": [
"#โ๏ธ 1.3. Document Classification using the 1st page\n",
"Most of the documents can be identified by the 1 page (given it's a real 1st page and not a separation, cover page, page with noise, etc - you can filter those out)."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "mpWAIp2MCt-w"
},
"source": [
""
]
},
{
"cell_type": "markdown",
"metadata": {
"collapsed": false,
"id": "MSkwdt0s3pqv"
},
"source": [
"We have some text classifiers which can be used to identify different legal documents:\n",
"- Based on `Bert`, taking the first 512 tokens;\n",
"- Based on `Longformers`, taking the first 4096 tokens, but being much slower;\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "Bwvqu95ZvPzV"
},
"source": [
"`We have more than 150 document classification models for both Longformer and Sentence Bert`"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "UDt83AOAvTuF"
},
"source": [
"### Using Sentence Bert\n",
"Check the Classification notebook to see Legal Longformers in action. By now we will stick with the 512 tokens Bert-base ones."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "iadkvMQmxw_8",
"outputId": "2f43c903-00ce-46c2-a28b-713f3f4a2321"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"sent_bert_base_cased download started this may take some time.\n",
"Approximate size to download 389.1 MB\n",
"[OK!]\n",
"legclf_credit_agreement_bert download started this may take some time.\n",
"[OK!]\n"
]
}
],
"source": [
"document_assembler = nlp.DocumentAssembler()\\\n",
" .setInputCol(\"text\")\\\n",
" .setOutputCol(\"document\")\n",
" \n",
"embeddings = nlp.BertSentenceEmbeddings.pretrained(\"sent_bert_base_cased\", \"en\")\\\n",
" .setInputCols(\"document\")\\\n",
" .setOutputCol(\"sentence_embeddings\")\n",
" \n",
"doc_classifier = legal.ClassifierDLModel.pretrained(\"legclf_credit_agreement_bert\", \"en\", \"legal/models\")\\\n",
" .setInputCols([\"sentence_embeddings\"])\\\n",
" .setOutputCol(\"category\")\n",
" \n",
"nlp_pipeline = nlp.Pipeline(stages=[\n",
" document_assembler, \n",
" embeddings,\n",
" doc_classifier])"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "qQoXUDtf4nid"
},
"source": [
"#### Using fit / transform (all Spark Cluster nodes)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "cdZIReyWwK_k"
},
"outputs": [],
"source": [
"df = spark.createDataFrame([[ pages[0] ]]).toDF(\"text\")\n",
"model = nlp_pipeline.fit(df)\n",
"result = model.transform(df)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "-MWeFfBhwNfN",
"outputId": "6ddc5fd5-b48d-44bf-a539-a7d8a5ca9473"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+------------------+\n",
"| result|\n",
"+------------------+\n",
"|[credit-agreement]|\n",
"+------------------+\n",
"\n"
]
}
],
"source": [
"result.select('category.result').show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "hgUvHQ7N4s_F"
},
"source": [
"#### Using Light Pipeline (only driver, quicker but not scalable for big amounts of documents)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "5Gy6VT394z2e",
"outputId": "178b8855-0534-44ee-bcd9-5c7f77d9a4cb"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"['credit-agreement']\n"
]
}
],
"source": [
"import json\n",
"\n",
"lp = nlp.LightPipeline(model)\n",
"json_res = lp.annotate( pages[0] )\n",
"print(json_res['category'])"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "kRaUagGo5NYM"
},
"source": [
"### Are you curious of what would happen with other pagesโ"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "zpC5pe7f5Q00",
"outputId": "a88fa03c-b1c8-4763-afa0-438aaf1e98ae"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[\n",
" {\n",
" \"document\": [\n",
" \"Exhibit 10.1\\n\\n EXECUTION COPY\\n\\n $225,000,000.00 REVOLVING CREDIT FACILITY\\n\\n CREDIT AGREEMENT\\n\\n by and among\\n\\n P.H. GLATFELTER COMPANY\\n\\n and\\n\\n Certain of its Subsidiaries, as Borrowers\\n\\n and\\n\\n THE BANKS PARTY HERETO, as Lenders\\n\\n and\\n\\n PNC BANK, NATIONAL ASSOCIATION, as Administrative Agent\\n\\n with\\n\\n PNC CAPITAL MARKETS LLC and CITIZENS BANK OF PENNSYLVANIA,\\n\\n as Joint Lead Arrangers and Joint Bookrunners\\n\\n and\\n\\n CITIZENS BANK OF PENNSYLVANIA, as Syndication Agent\\n\\n Dated as of April 29, 2010\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n1. CERTAIN DEFINITIONS.................................................. 1\\n 1.1 Certain Definitions............................................ 1\\n 1.2 Construction................................................... 28\\n 1.2.1 Number; Inclusion...................................... 28\\n 1.2.2 Determination.......................................... 28\\n 1.2.3 Administrative Agent's Discretion and Consent.......... 28\\n 1.2.4 Documents Taken as a Whole............................. 28\\n 1.2.5 Headings............................................... 29\\n 1.2.6 Implied References to this Agreement................... 29\\n 1.2.7 Persons................................................ 29\\n 1.2.8 Modifications to Documents............................. 29\\n 1.2.9 From, To and Through................................... 29\\n 1.2.10 Shall; Will............................................ 29\\n 1.2.11 Quebec Matters......................................... 29\\n 1.3 Accounting Principles.......................................... 30\\n2. REVOLVING CREDIT AND SWING LOAN FACILITIES........................... 31\\n 2.1 Revolving Credit Commitments................................... 31\\n 2.1.1 Revolving Credit Loans................................. 31\\n 2.1.2 Swing Loan Commitment.................................. 33\\n 2.2 Nature of Lenders' Obligations with Respect to Revolving Credit\\n Loans.......................................................... 33\\n 2.3 Commitment Fees................................................ 33\\n 2.4 Revolving Credit Loan Requests................................. 34\\n 2.4.1 Revolving Credit Loan Requests......................... 34\\n 2.4.2 Swing Loan Requests.................................... 34\\n 2.5 Making Revolving Credit Loans and Swing Loans; Revolving Credit\\n Notes and Swing Notes.......................................... 35\\n 2.5.1 Making Revolving Credit Loans.......................... 35\\n 2.5.2 Making Swing Loans..................................... 35\\n 2.6 Revolving Credit Notes......................................... 35\\n 2.7 Swing Loan Note................................................ 35\\n 2.8 Borrowings to Repay Swing Loans................................ 36\\n 2.9 Utilization of Commitments in Optional Currencies.............. 36\\n 2.9.1 Periodic Computations of Dollar Equivalent Amounts of\\n Revolving Credit Loans and Letters of Credit\\n Outstanding............................................ 36\\n 2.9.2 Notices From Lenders That Optional Currencies Are\\n Unavailable to Fund New Loans.......................... 36\\n 2.9.3 Notices From Lenders That Optional Currencies Are\\n Unavailable to Fund Renewals of the Euro-Rate Option... 37\\n 2.9.4 European Monetary Union................................ 37\\n\\n\\n\\n -i-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n 2.9.5 Requests for Additional Optional Currencies............ 38\\n 2.10 Use of Proceeds................................................ 38\\n 2.11 Letter of Credit Subfacility................................... 38\\n 2.11.1 Issuance of Letters of Credit.......................... 38\\n 2.11.2 Letter of Credit Fees.................................. 39\\n 2.11.3 Disbursements, Reimbursement........................... 39\\n 2.11.4 Repayment of Participation Advances.................... 41\\n 2.11.5 Documentation.......................................... 41\\n 2.11.6 Determinations to Honor Drawing Requests............... 42\\n 2.11.7 Nature of Participation and Reimbursement Obligations.. 42\\n 2.11.8 Indemnity.............................................. 44\\n 2.11.9 Liability for Acts and Omissions....................... 44\\n 2.12 Currency Repayments............................................ 46\\n 2.13 Optional Currency Amounts...................................... 46\\n 2.14 Reduction of Commitment........................................ 46\\n3. INTEREST RATES....................................................... 47\\n 3.1 Interest Rate Options.......................................... 47\\n 3.1.1 Interest Rate Options.................................. 47\\n 3.1.2 Rate Quotations........................................ 47\\n 3.2 Interest Periods............................................... 48\\n 3.2.1 Amount of Borrowing Tranche............................ 48\\n 3.2.2 Renewals............................................... 48\\n 3.3 Interest After Default......................................... 48\\n 3.3.1 Letter of Credit Fees, Interest Rate................... 48\\n 3.3.2 Other Obligations...................................... 48\\n 3.3.3 Acknowledgment......................................... 48\\n 3.4 Euro-Rate Unascertainable; Illegality; Increased Costs;\\n Deposits Not Available......................................... 49\\n 3.4.1 Unascertainable........................................ 49\\n 3.4.2 Illegality; Increased Costs; Deposits Not Available.... 49\\n 3.4.3 Administrative Agent's and Lender's Rights............. 49\\n 3.5 Selection of Interest Rate Options............................. 50\\n 3.6 Canadian Interest Act Disclosure............................... 50\\n 3.7 Canadian Usury Provision....................................... 50\\n4. PAYMENTS............................................................. 51\\n 4.1 Payments....................................................... 51\\n 4.2 Pro Rata Treatment of Lenders.................................. 52\\n 4.3 Interest Payment Dates......................................... 52\\n 4.4 Voluntary Prepayments.......................................... 52\\n\\n\\n\\n -ii-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n 4.4.1 Right to Prepay........................................ 52\\n 4.4.2 Replacement of a Lender................................ 53\\n 4.4.3 Change of Lending Office............................... 54\\n 4.5 Mandatory Prepayments.......................................... 54\\n 4.5.1 Currency Fluctuations.................................. 54\\n 4.5.2 Application Among Interest Rate Options................ 55\\n 4.6 Additional Compensation in Certain Circumstances............... 55\\n 4.6.1 Increased Costs or Reduced Return Resulting from Taxes,\\n Reserves, Capital Adequacy Requirements, Expenses,\\n Etc.................................................... 55\\n 4.6.2 Indemnity.............................................. 56\\n 4.7 Interbank Market Presumption................................... 56\\n 4.8 Taxes.......................................................... 57\\n 4.8.1 No Deductions.......................................... 57\\n 4.8.2 Stamp Taxes............................................ 57\\n 4.8.3 Indemnification for Taxes Paid by a Lender............. 57\\n 4.8.4 Certificate............................................ 57\\n 4.8.5 Exclusions, etc........................................ 58\\n 4.8.6 Change of Lending Office, etc.......................... 58\\n 4.8.7 Survival............................................... 58\\n 4.9 Judgment Currency.............................................. 58\\n 4.9.1 Currency Conversion Procedures for Judgments........... 58\\n 4.9.2 Indemnity in Certain Events............................ 59\\n 4.10 Notes.......................................................... 59\\n 4.11 Settlement Date Procedures..................................... 59\\n 4.12 Borrowers' Agent............................................... 60\\n5. REPRESENTATIONS AND WARRANTIES....................................... 60\\n 5.1 Representations and Warranties................................. 60\\n 5.1.1 Organization and Qualification......................... 60\\n 5.1.2 Subsidiaries........................................... 60\\n 5.1.3 Power and Authority.................................... 61\\n 5.1.4 Validity and Binding Effect............................ 61\\n 5.1.5 No Conflict............................................ 61\\n 5.1.6 Litigation............................................. 62\\n 5.1.7 Title to Properties.................................... 62\\n 5.1.8 Financial Statements................................... 62\\n 5.1.9 Use of Proceeds; Margin Stock.......................... 63\\n 5.1.10 Full Disclosure........................................ 63\\n 5.1.11 Taxes.................................................. 63\\n 5.1.12 Consents and Approvals................................. 64\\n 5.1.13 No Event of Default; Compliance with Instruments....... 64\\n\\n\\n\\n -iii-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n 5.1.14 Patents, Trademarks, Copyrights, Licenses, Etc......... 64\\n 5.1.15 Insurance.............................................. 64\\n 5.1.16 Compliance with Laws................................... 65\\n 5.1.17 Material Contracts; Burdensome Restrictions............ 65\\n 5.1.18 Investment Companies; Regulated Entities............... 65\\n 5.1.19 Plans and Benefit Arrangements......................... 65\\n 5.1.20 Employment Matters..................................... 66\\n 5.1.21 Environmental Matters.................................. 67\\n 5.1.22 Senior Debt Status..................................... 68\\n 5.1.23 Anti-Terrorism Laws.................................... 68\\n 5.2 Continuation of Representations................................ 70\\n 5.3 Updates to Schedules........................................... 70\\n6. CONDITIONS OF LENDING AND ISSUANCE OF LETTERS OF CREDIT.............. 70\\n 6.1 First Loans and Letters of Credit.............................. 70\\n 6.1.1 Officer's Certificate.................................. 70\\n 6.1.2 Secretary's Certificate................................ 71\\n 6.1.3 Delivery of Loan Documents............................. 71\\n 6.1.4 Opinion of Counsel..................................... 71\\n 6.1.5 Legal Details.......................................... 72\\n 6.1.6 Payment of Fees........................................ 72\\n 6.1.7 Consents............................................... 72\\n 6.1.8 Officer's Certificate Regarding MACs................... 72\\n 6.1.9 No Violation of Laws................................... 72\\n 6.1.10 No Actions or Proceedings; No Material Litigation...... 72\\n 6.1.11 Other Requirements..................................... 73\\n 6.2 Each Additional Loan or Letter of Credit....................... 73\\n 6.3 Loans to Fund Acquisitions..................................... 73\\n7. COVENANTS............................................................ 73\\n 7.1 Affirmative Covenants.......................................... 73\\n 7.1.1 Preservation of Existence, Etc......................... 73\\n 7.1.2 Payment of Liabilities, Including Taxes, Etc........... 74\\n 7.1.3 Maintenance of Insurance............................... 74\\n 7.1.4 Maintenance of Properties and Leases................... 74\\n 7.1.5 Maintenance of Patents, Trademarks, Etc................ 74\\n 7.1.6 Visitation Rights...................................... 75\\n 7.1.7 Keeping of Records and Books of Account................ 75\\n 7.1.8 Plans and Benefit Arrangements......................... 75\\n 7.1.9 Compliance with Laws................................... 75\\n 7.1.10 Joinder of Guarantors and Borrowers.................... 76\\n\\n\\n\\n -iv-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n 7.1.11 Anti-Terrorism Laws.................................... 76\\n 7.1.12 German and English Borrowers........................... 77\\n 7.2 Negative Covenants............................................. 78\\n 7.2.1 Indebtedness........................................... 78\\n 7.2.2 Liens.................................................. 80\\n 7.2.3 Guaranties............................................. 80\\n 7.2.4 Loans and Investments.................................. 80\\n 7.2.5 Dividends and Related Distributions.................... 82\\n 7.2.6 Liquidations, Mergers, Consolidations, Acquisitions.... 82\\n 7.2.7 Dispositions of Assets or Subsidiaries................. 84\\n 7.2.8 Affiliate Transactions................................. 85\\n 7.2.9 Subsidiaries........................................... 85\\n 7.2.10 Continuation of or Change in Business.................. 86\\n 7.2.11 Plans and Benefit Arrangements......................... 86\\n 7.2.12 Fiscal Year............................................ 86\\n 7.2.13 Issuance of Stock...................................... 86\\n 7.2.14 Changes in Organizational Documents.................... 86\\n 7.2.15 Maximum Leverage Ratio................................. 87\\n 7.2.16 Minimum Interest Coverage Ratio........................ 87\\n 7.2.17 Receivables Entities and Timberland Note Monetization\\n Entities............................................... 87\\n 7.3 Reporting Requirements......................................... 88\\n 7.3.1 Quarterly Financial Statements......................... 88\\n 7.3.2 Annual Financial Statements............................ 88\\n 7.3.3 Certificate of the Borrower............................ 89\\n 7.3.4 Notice of Default...................................... 89\\n 7.3.5 Notice of Litigation................................... 89\\n 7.3.6 Notice of Change in Debt Rating........................ 89\\n 7.3.7 Certain Events......................................... 90\\n 7.3.8 Budgets, Forecasts, Other Reports and Information...... 90\\n 7.3.9 Notices Regarding Plans and Benefit Arrangements....... 91\\n8. DEFAULT.............................................................. 92\\n 8.1 Events of Default.............................................. 92\\n 8.1.1 Payments Under Loan Documents.......................... 92\\n 8.1.2 Breach of Warranty..................................... 92\\n 8.1.3 Breach of Negative Covenants and Certain Affirmative\\n Covenants.............................................. 92\\n 8.1.4 Breach of Other Covenants.............................. 93\\n 8.1.5 Defaults in Other Agreements or Indebtedness........... 93\\n 8.1.6 Final Judgments or Orders.............................. 93\\n 8.1.7 Loan Document Unenforceable............................ 93\\n\\n\\n\\n -v-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n 8.1.8 Proceedings Against Assets............................. 93\\n 8.1.9 Notice of Lien or Assessment........................... 94\\n 8.1.10 Insolvency............................................. 94\\n 8.1.11 Events Relating to Plans and Benefit Arrangements...... 94\\n 8.1.12 Cessation of Business.................................. 94\\n 8.1.13 Change of Control...................................... 95\\n 8.1.14 Involuntary Proceedings................................ 95\\n 8.1.15 Voluntary Proceedings.................................. 95\\n 8.2 Consequences of Event of Default............................... 96\\n 8.2.1 Events of Default Other Than Bankruptcy, Insolvency or\\n Reorganization Proceedings............................. 96\\n 8.2.2 Bankruptcy, Insolvency or Reorganization Proceedings... 96\\n 8.2.3 Set-off................................................ 96\\n 8.2.4 Suits, Actions, Proceedings............................ 97\\n 8.2.5 Application of Proceeds................................ 97\\n9. THE AGENT............................................................ 98\\n 9.1 Appointment.................................................... 98\\n 9.2 Delegation of Duties........................................... 98\\n 9.3 Nature of Duties; Independent Credit Investigation............. 98\\n 9.4 Actions in Discretion of Administrative Agent; Instructions\\n From the Lenders............................................... 99\\n 9.5 Reimbursement and Indemnification of Administrative Agent by\\n the Borrower................................................... 99\\n 9.6 Exculpatory Provisions; Limitation of Liability................ 100\\n 9.7 Reimbursement and Indemnification of Administrative Agent by\\n Lenders........................................................ 101\\n 9.8 Reliance by Administrative Agent............................... 101\\n 9.9 Notice of Default.............................................. 102\\n 9.10 Notices........................................................ 102\\n 9.11 Lenders in Their Individual Capacities; Administrative Agent in\\n its Individual Capacity........................................ 102\\n 9.12 Holders of Notes............................................... 102\\n 9.13 Sharing of Payments............................................ 103\\n 9.14 Successor Administrative Agent................................. 103\\n 9.15 Administrative Agent's Fee..................................... 104\\n 9.16 Availability of Funds.......................................... 104\\n 9.17 Calculations................................................... 104\\n 9.18 No Reliance on Administrative Agent's Customer Identification\\n Program........................................................ 105\\n 9.19 Beneficiaries.................................................. 105\\n\\n\\n\\n -vi-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n10. MISCELLANEOUS........................................................ 105\\n 10.1 Modifications, Amendments or Waivers........................... 105\\n 10.1.1 Increase of Commitment................................. 105\\n 10.1.2 Extension of Payment; Reduction of Principal Interest\\n or Fees................................................ 106\\n 10.1.3 Release a Guarantor.................................... 106\\n 10.1.4 Miscellaneous.......................................... 106\\n 10.2 No Implied Waivers; Cumulative Remedies; Writing Required...... 106\\n 10.3 Reimbursement and Indemnification of Lenders by the Borrower... 107\\n 10.4 Holidays....................................................... 107\\n 10.5 Funding by Branch, Subsidiary or Affiliate..................... 108\\n 10.5.1 Notional Funding....................................... 108\\n 10.5.2 Actual Funding......................................... 108\\n 10.6 Notices; Lending Offices....................................... 108\\n 10.7 Severability................................................... 109\\n 10.8 Governing Law.................................................. 110\\n 10.9 Prior Understanding............................................ 110\\n 10.10 Duration; Survival............................................. 110\\n 10.11 Successors and Assigns......................................... 110\\n 10.12 Confidentiality................................................ 112\\n 10.12.1 General................................................ 112\\n 10.12.2 Sharing Information With Affiliates of the Lenders..... 112\\n 10.13 Counterparts................................................... 113\\n 10.14 Administrative Agent's or Lender's Consent..................... 113\\n 10.15 Exceptions..................................................... 113\\n 10.16 CONSENT TO FORUM; WAIVER OF JURY TRIAL......................... 113\\n 10.17 Certifications From Lenders and Participants................... 114\\n 10.17.1 Tax Withholding........................................ 114\\n 10.17.2 USA Patriot Act........................................ 115\\n 10.18 Nature of Foreign Borrower Obligations......................... 115\\n 10.19 Pledge of Foreign Loan Party Loans............................. 116\\n\\n\\n\\n -vii-\\n\\n\\n\\n LIST OF SCHEDULES AND EXHIBITS\\n\\nSCHEDULES\\nSCHEDULE 1.1(A) - PRICING GRID\\nSCHEDULE 1.1(B) - COMMITMENTS OF BANKS AND ADDRESSES FOR NOTICES\\nSCHEDULE 1.1(E) - EXISTING LETTERS OF CREDIT\\nSCHEDULE 1.1(M) - MATERIAL SUBSIDIARIES\\nSCHEDULE 1.1(P) - PERMITTED LIENS\\nSCHEDULE 5.1.1 - DOMESTIC QUALIFICATIONS TO DO BUSINESS\\nSCHEDULE 5.1.2 - SUBSIDIARIES\\nSCHEDULE 5.1.6 - LITIGATION\\nSCHEDULE 5.1.12 - CONSENTS AND APPROVALS\\nSCHEDULE 5.1.14 - PATENTS, TRADEMARKS, COPYRIGHTS, LICENSES, ETC.\\nSCHEDULE 7.2.1 - PERMITTED INDEBTEDNESS\\nSCHEDULE 7.2.4 - EXISTING INVESTMENTS\\n\\nEXHIBITS\\nEXHIBIT 1.1(A) - ASSIGNMENT AND ASSUMPTION AGREEMENT\\nEXHIBIT 1.1(B) - BORROWER JOINDER\\nEXHIBIT 1.1(G)(1) - GUARANTOR JOINDER\\nEXHIBIT 1.1(G)(2) - GUARANTY AGREEMENT\\nEXHIBIT 1.1(R) - REVOLVING CREDIT NOTE\\nEXHIBIT 1.1(S) - SWING LOAN NOTE\\nEXHIBIT 2.4 - LOAN REQUEST\\nEXHIBIT 6.1.4 - OPINION OF COUNSEL\\nEXHIBIT 7.2.6 - ACQUISITION COMPLIANCE CERTIFICATE\\nEXHIBIT 7.3.3 - QUARTERLY COMPLIANCE CERTIFICATE\\n\\n\\n -viii-\\n\\n\\n\\n CREDIT AGREEMENT\\n\\n THIS CREDIT AGREEMENT is dated as of April 29, 2010, and is made by and\\namong P.H. GLATFELTER COMPANY, a Pennsylvania corporation ( the \\\"COMPANY\\\") and\\ncertain of its subsidiaries identified on the signature pages hereto (each a\\n\\\"BORROWER\\\" and collectively, the \\\"BORROWERS\\\"), each of the GUARANTORS (as\\nhereinafter defined), the LENDERS (as hereinafter defined), PNC BANK, NATIONAL\\nASSOCIATION, in its capacity as agent for the Lenders under this Agreement\\n(hereinafter referred to in such capacity as the \\\"ADMINISTRATIVE AGENT\\\"), and,\\nfor the limited purpose of public identification in trade tables, PNC CAPITAL\\nMARKETS LLC and CITIZENS BANK OF PENNSYLVANIA, as joint arrangers and joint\\nbookrunners, and CITIZENS BANK OF PENNSYLVANIA, as syndication agent.\\n\\n WITNESSETH:\\n\\n WHEREAS, the Borrowers have requested the Lenders to provide a revolving\\ncredit facility to the Borrowers in an aggregate principal amount not to exceed\\n$225,000,000; and\\n\\n WHEREAS, proceeds of the revolving credit facility shall be used for (1)\\nrefinancing existing Indebtedness, and (2) general corporate purposes; and\\n\\n WHEREAS, the Lenders are willing to provide such credit upon the terms and\\nconditions hereinafter set forth;\\n\\n NOW, THEREFORE, the parties hereto, in consideration of their mutual\\ncovenants and agreements hereinafter set forth and intending to be legally bound\\nhereby, covenant and agree as follows:\\n\\n 1. CERTAIN DEFINITIONS\\n\\n 1.1 CERTAIN DEFINITIONS.\\n\\n In addition to words and terms defined elsewhere in this Agreement,\\nthe following words and terms shall have the following meanings, respectively,\\nunless the context hereof clearly requires otherwise:\\n\\n 2006 SENIOR NOTES shall mean the Company's 7 ?% senior notes,\\nissued in 2006 and due May 1, 2016, in the aggregate principal amount of\\n$200,000,000, guarantied by certain of the Loan Parties.\\n\\n 2010 SENIOR NOTES shall mean the Company's 7 ?% senior notes,\\nissued in 2010 and due May 1, 2016, in the aggregate principal amount of\\n$100,000,000, guarantied by certain of the Loan Parties.\\n\\n ACCOUNTS RECEIVABLE FACILITY DOCUMENTS means all documentation\\nentered into by the Company and its Subsidiaries, including, without limitation,\\nthe Receivables Entity, in connection with the sale or other transfer of\\naccounts receivable and other related assets pursuant to a Permitted Accounts\\nReceivable Program, as such documentation may be\\n\\n\\n\\namended, restated, supplemented or otherwise modified from time to time in\\naccordance with the terms hereof and thereof.\\n\\n ADMINISTRATIVE AGENT shall have the meaning given to such term in\\nthe introductory paragraph hereof.\\n\\n ADMINISTRATIVE AGENT'S FEE shall have the meaning assigned to\\nthat term in Section 9.15.\\n\\n ADMINISTRATIVE AGENT'S LETTER shall have the meaning assigned to\\nthat term in Section 9.15.\\n\\n AFFILIATE as to any Person shall mean any other Person (i) which,\\ndirectly or indirectly controls, is controlled by, or is under common control\\nwith such Person. For purposes of this definition, \\\"control\\\" (including, with\\ncorrelative meanings, the term \\\"controlled by\\\" and \\\"under common control with\\\")\\nshall mean the power, directly or indirectly, either to (a) vote 10% or more of\\nthe securities having ordinary voting power for the election of directors of\\nsuch Person or (b) direct or cause the direction of the management and policies\\nof such Person whether through the ownership of voting securities or by contract\\nor otherwise, including the power to elect a majority of the directors of a\\ncorporation.\\n\\n AGREEMENT shall mean this Credit Agreement, as the same may be\\nextended, renewed, amended, supplemented or restated from time to time,\\nincluding all schedules and exhibits.\\n\\n ANTI-TERRORISM LAWS shall mean any Laws relating to terrorism or\\nmoney laundering, including Executive Order No. 13224, the USA Patriot Act, the\\nLaws comprising or implementing the Bank Secrecy Act, and the Laws administered\\nby the United States Treasury Department's Office of Foreign Asset Control (as\\nany of the foregoing Laws may from time to time be amended, renewed, extended,\\nor replaced).\\n\\n APPLICABLE COMMITMENT FEE RATE shall mean the percentage rate per\\nannum at the indicated level of Debt Rating in the pricing grid on SCHEDULE\\n1.1(A) next to the line titled \\\"Commitment Fee.\\\" The Applicable Commitment Fee\\nRate shall be computed in accordance with the parameters set forth on SCHEDULE\\n1.1(A).\\n\\n APPLICABLE MARGIN shall mean the percentage spread to be added to\\nEuro-Rate under the Euro-Rate Option or to the Base Rate under the Base Rate\\nOption at the indicated level of Debt Rating in the pricing grid on SCHEDULE\\n1.1(A) next to the line titled \\\"Euro-Rate Spread\\\" or \\\"Base Rate Spread.\\\" The\\nApplicable Margin shall be computed in accordance with the parameters set forth\\non SCHEDULE 1.1(A).\\n\\n ASSIGNMENT AND ASSUMPTION AGREEMENT shall mean an Assignment and\\nAssumption Agreement by and among a Purchasing Lender, a Transferor Lender and\\nthe Administrative Agent, as Administrative Agent and on behalf of the remaining\\nLenders, substantially in the form of EXHIBIT 1.1(A).\"\n",
" ],\n",
" \"sentence_embeddings\": [\n",
" \"Exhibit 10.1\\n\\n EXECUTION COPY\\n\\n $225,000,000.00 REVOLVING CREDIT FACILITY\\n\\n CREDIT AGREEMENT\\n\\n by and among\\n\\n P.H. GLATFELTER COMPANY\\n\\n and\\n\\n Certain of its Subsidiaries, as Borrowers\\n\\n and\\n\\n THE BANKS PARTY HERETO, as Lenders\\n\\n and\\n\\n PNC BANK, NATIONAL ASSOCIATION, as Administrative Agent\\n\\n with\\n\\n PNC CAPITAL MARKETS LLC and CITIZENS BANK OF PENNSYLVANIA,\\n\\n as Joint Lead Arrangers and Joint Bookrunners\\n\\n and\\n\\n CITIZENS BANK OF PENNSYLVANIA, as Syndication Agent\\n\\n Dated as of April 29, 2010\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n1. CERTAIN DEFINITIONS.................................................. 1\\n 1.1 Certain Definitions............................................ 1\\n 1.2 Construction................................................... 28\\n 1.2.1 Number; Inclusion...................................... 28\\n 1.2.2 Determination.......................................... 28\\n 1.2.3 Administrative Agent's Discretion and Consent.......... 28\\n 1.2.4 Documents Taken as a Whole............................. 28\\n 1.2.5 Headings............................................... 29\\n 1.2.6 Implied References to this Agreement................... 29\\n 1.2.7 Persons................................................ 29\\n 1.2.8 Modifications to Documents............................. 29\\n 1.2.9 From, To and Through................................... 29\\n 1.2.10 Shall; Will............................................ 29\\n 1.2.11 Quebec Matters......................................... 29\\n 1.3 Accounting Principles.......................................... 30\\n2. REVOLVING CREDIT AND SWING LOAN FACILITIES........................... 31\\n 2.1 Revolving Credit Commitments................................... 31\\n 2.1.1 Revolving Credit Loans................................. 31\\n 2.1.2 Swing Loan Commitment.................................. 33\\n 2.2 Nature of Lenders' Obligations with Respect to Revolving Credit\\n Loans.......................................................... 33\\n 2.3 Commitment Fees................................................ 33\\n 2.4 Revolving Credit Loan Requests................................. 34\\n 2.4.1 Revolving Credit Loan Requests......................... 34\\n 2.4.2 Swing Loan Requests.................................... 34\\n 2.5 Making Revolving Credit Loans and Swing Loans; Revolving Credit\\n Notes and Swing Notes.......................................... 35\\n 2.5.1 Making Revolving Credit Loans.......................... 35\\n 2.5.2 Making Swing Loans..................................... 35\\n 2.6 Revolving Credit Notes......................................... 35\\n 2.7 Swing Loan Note................................................ 35\\n 2.8 Borrowings to Repay Swing Loans................................ 36\\n 2.9 Utilization of Commitments in Optional Currencies.............. 36\\n 2.9.1 Periodic Computations of Dollar Equivalent Amounts of\\n Revolving Credit Loans and Letters of Credit\\n Outstanding............................................ 36\\n 2.9.2 Notices From Lenders That Optional Currencies Are\\n Unavailable to Fund New Loans.......................... 36\\n 2.9.3 Notices From Lenders That Optional Currencies Are\\n Unavailable to Fund Renewals of the Euro-Rate Option... 37\\n 2.9.4 European Monetary Union................................ 37\\n\\n\\n\\n -i-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n 2.9.5 Requests for Additional Optional Currencies............ 38\\n 2.10 Use of Proceeds................................................ 38\\n 2.11 Letter of Credit Subfacility................................... 38\\n 2.11.1 Issuance of Letters of Credit.......................... 38\\n 2.11.2 Letter of Credit Fees.................................. 39\\n 2.11.3 Disbursements, Reimbursement........................... 39\\n 2.11.4 Repayment of Participation Advances.................... 41\\n 2.11.5 Documentation.......................................... 41\\n 2.11.6 Determinations to Honor Drawing Requests............... 42\\n 2.11.7 Nature of Participation and Reimbursement Obligations.. 42\\n 2.11.8 Indemnity.............................................. 44\\n 2.11.9 Liability for Acts and Omissions....................... 44\\n 2.12 Currency Repayments............................................ 46\\n 2.13 Optional Currency Amounts...................................... 46\\n 2.14 Reduction of Commitment........................................ 46\\n3. INTEREST RATES....................................................... 47\\n 3.1 Interest Rate Options.......................................... 47\\n 3.1.1 Interest Rate Options.................................. 47\\n 3.1.2 Rate Quotations........................................ 47\\n 3.2 Interest Periods............................................... 48\\n 3.2.1 Amount of Borrowing Tranche............................ 48\\n 3.2.2 Renewals............................................... 48\\n 3.3 Interest After Default......................................... 48\\n 3.3.1 Letter of Credit Fees, Interest Rate................... 48\\n 3.3.2 Other Obligations...................................... 48\\n 3.3.3 Acknowledgment......................................... 48\\n 3.4 Euro-Rate Unascertainable; Illegality; Increased Costs;\\n Deposits Not Available......................................... 49\\n 3.4.1 Unascertainable........................................ 49\\n 3.4.2 Illegality; Increased Costs; Deposits Not Available.... 49\\n 3.4.3 Administrative Agent's and Lender's Rights............. 49\\n 3.5 Selection of Interest Rate Options............................. 50\\n 3.6 Canadian Interest Act Disclosure............................... 50\\n 3.7 Canadian Usury Provision....................................... 50\\n4. PAYMENTS............................................................. 51\\n 4.1 Payments....................................................... 51\\n 4.2 Pro Rata Treatment of Lenders.................................. 52\\n 4.3 Interest Payment Dates......................................... 52\\n 4.4 Voluntary Prepayments.......................................... 52\\n\\n\\n\\n -ii-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n 4.4.1 Right to Prepay........................................ 52\\n 4.4.2 Replacement of a Lender................................ 53\\n 4.4.3 Change of Lending Office............................... 54\\n 4.5 Mandatory Prepayments.......................................... 54\\n 4.5.1 Currency Fluctuations.................................. 54\\n 4.5.2 Application Among Interest Rate Options................ 55\\n 4.6 Additional Compensation in Certain Circumstances............... 55\\n 4.6.1 Increased Costs or Reduced Return Resulting from Taxes,\\n Reserves, Capital Adequacy Requirements, Expenses,\\n Etc.................................................... 55\\n 4.6.2 Indemnity.............................................. 56\\n 4.7 Interbank Market Presumption................................... 56\\n 4.8 Taxes.......................................................... 57\\n 4.8.1 No Deductions.......................................... 57\\n 4.8.2 Stamp Taxes............................................ 57\\n 4.8.3 Indemnification for Taxes Paid by a Lender............. 57\\n 4.8.4 Certificate............................................ 57\\n 4.8.5 Exclusions, etc........................................ 58\\n 4.8.6 Change of Lending Office, etc.......................... 58\\n 4.8.7 Survival............................................... 58\\n 4.9 Judgment Currency.............................................. 58\\n 4.9.1 Currency Conversion Procedures for Judgments........... 58\\n 4.9.2 Indemnity in Certain Events............................ 59\\n 4.10 Notes.......................................................... 59\\n 4.11 Settlement Date Procedures..................................... 59\\n 4.12 Borrowers' Agent............................................... 60\\n5. REPRESENTATIONS AND WARRANTIES....................................... 60\\n 5.1 Representations and Warranties................................. 60\\n 5.1.1 Organization and Qualification......................... 60\\n 5.1.2 Subsidiaries........................................... 60\\n 5.1.3 Power and Authority.................................... 61\\n 5.1.4 Validity and Binding Effect............................ 61\\n 5.1.5 No Conflict............................................ 61\\n 5.1.6 Litigation............................................. 62\\n 5.1.7 Title to Properties.................................... 62\\n 5.1.8 Financial Statements................................... 62\\n 5.1.9 Use of Proceeds; Margin Stock.......................... 63\\n 5.1.10 Full Disclosure........................................ 63\\n 5.1.11 Taxes.................................................. 63\\n 5.1.12 Consents and Approvals................................. 64\\n 5.1.13 No Event of Default; Compliance with Instruments....... 64\\n\\n\\n\\n -iii-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n 5.1.14 Patents, Trademarks, Copyrights, Licenses, Etc......... 64\\n 5.1.15 Insurance.............................................. 64\\n 5.1.16 Compliance with Laws................................... 65\\n 5.1.17 Material Contracts; Burdensome Restrictions............ 65\\n 5.1.18 Investment Companies; Regulated Entities............... 65\\n 5.1.19 Plans and Benefit Arrangements......................... 65\\n 5.1.20 Employment Matters..................................... 66\\n 5.1.21 Environmental Matters.................................. 67\\n 5.1.22 Senior Debt Status..................................... 68\\n 5.1.23 Anti-Terrorism Laws.................................... 68\\n 5.2 Continuation of Representations................................ 70\\n 5.3 Updates to Schedules........................................... 70\\n6. CONDITIONS OF LENDING AND ISSUANCE OF LETTERS OF CREDIT.............. 70\\n 6.1 First Loans and Letters of Credit.............................. 70\\n 6.1.1 Officer's Certificate.................................. 70\\n 6.1.2 Secretary's Certificate................................ 71\\n 6.1.3 Delivery of Loan Documents............................. 71\\n 6.1.4 Opinion of Counsel..................................... 71\\n 6.1.5 Legal Details.......................................... 72\\n 6.1.6 Payment of Fees........................................ 72\\n 6.1.7 Consents............................................... 72\\n 6.1.8 Officer's Certificate Regarding MACs................... 72\\n 6.1.9 No Violation of Laws................................... 72\\n 6.1.10 No Actions or Proceedings; No Material Litigation...... 72\\n 6.1.11 Other Requirements..................................... 73\\n 6.2 Each Additional Loan or Letter of Credit....................... 73\\n 6.3 Loans to Fund Acquisitions..................................... 73\\n7. COVENANTS............................................................ 73\\n 7.1 Affirmative Covenants.......................................... 73\\n 7.1.1 Preservation of Existence, Etc......................... 73\\n 7.1.2 Payment of Liabilities, Including Taxes, Etc........... 74\\n 7.1.3 Maintenance of Insurance............................... 74\\n 7.1.4 Maintenance of Properties and Leases................... 74\\n 7.1.5 Maintenance of Patents, Trademarks, Etc................ 74\\n 7.1.6 Visitation Rights...................................... 75\\n 7.1.7 Keeping of Records and Books of Account................ 75\\n 7.1.8 Plans and Benefit Arrangements......................... 75\\n 7.1.9 Compliance with Laws................................... 75\\n 7.1.10 Joinder of Guarantors and Borrowers.................... 76\\n\\n\\n\\n -iv-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n 7.1.11 Anti-Terrorism Laws.................................... 76\\n 7.1.12 German and English Borrowers........................... 77\\n 7.2 Negative Covenants............................................. 78\\n 7.2.1 Indebtedness........................................... 78\\n 7.2.2 Liens.................................................. 80\\n 7.2.3 Guaranties............................................. 80\\n 7.2.4 Loans and Investments.................................. 80\\n 7.2.5 Dividends and Related Distributions.................... 82\\n 7.2.6 Liquidations, Mergers, Consolidations, Acquisitions.... 82\\n 7.2.7 Dispositions of Assets or Subsidiaries................. 84\\n 7.2.8 Affiliate Transactions................................. 85\\n 7.2.9 Subsidiaries........................................... 85\\n 7.2.10 Continuation of or Change in Business.................. 86\\n 7.2.11 Plans and Benefit Arrangements......................... 86\\n 7.2.12 Fiscal Year............................................ 86\\n 7.2.13 Issuance of Stock...................................... 86\\n 7.2.14 Changes in Organizational Documents.................... 86\\n 7.2.15 Maximum Leverage Ratio................................. 87\\n 7.2.16 Minimum Interest Coverage Ratio........................ 87\\n 7.2.17 Receivables Entities and Timberland Note Monetization\\n Entities............................................... 87\\n 7.3 Reporting Requirements......................................... 88\\n 7.3.1 Quarterly Financial Statements......................... 88\\n 7.3.2 Annual Financial Statements............................ 88\\n 7.3.3 Certificate of the Borrower............................ 89\\n 7.3.4 Notice of Default...................................... 89\\n 7.3.5 Notice of Litigation................................... 89\\n 7.3.6 Notice of Change in Debt Rating........................ 89\\n 7.3.7 Certain Events......................................... 90\\n 7.3.8 Budgets, Forecasts, Other Reports and Information...... 90\\n 7.3.9 Notices Regarding Plans and Benefit Arrangements....... 91\\n8. DEFAULT.............................................................. 92\\n 8.1 Events of Default.............................................. 92\\n 8.1.1 Payments Under Loan Documents.......................... 92\\n 8.1.2 Breach of Warranty..................................... 92\\n 8.1.3 Breach of Negative Covenants and Certain Affirmative\\n Covenants.............................................. 92\\n 8.1.4 Breach of Other Covenants.............................. 93\\n 8.1.5 Defaults in Other Agreements or Indebtedness........... 93\\n 8.1.6 Final Judgments or Orders.............................. 93\\n 8.1.7 Loan Document Unenforceable............................ 93\\n\\n\\n\\n -v-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n 8.1.8 Proceedings Against Assets............................. 93\\n 8.1.9 Notice of Lien or Assessment........................... 94\\n 8.1.10 Insolvency............................................. 94\\n 8.1.11 Events Relating to Plans and Benefit Arrangements...... 94\\n 8.1.12 Cessation of Business.................................. 94\\n 8.1.13 Change of Control...................................... 95\\n 8.1.14 Involuntary Proceedings................................ 95\\n 8.1.15 Voluntary Proceedings.................................. 95\\n 8.2 Consequences of Event of Default............................... 96\\n 8.2.1 Events of Default Other Than Bankruptcy, Insolvency or\\n Reorganization Proceedings............................. 96\\n 8.2.2 Bankruptcy, Insolvency or Reorganization Proceedings... 96\\n 8.2.3 Set-off................................................ 96\\n 8.2.4 Suits, Actions, Proceedings............................ 97\\n 8.2.5 Application of Proceeds................................ 97\\n9. THE AGENT............................................................ 98\\n 9.1 Appointment.................................................... 98\\n 9.2 Delegation of Duties........................................... 98\\n 9.3 Nature of Duties; Independent Credit Investigation............. 98\\n 9.4 Actions in Discretion of Administrative Agent; Instructions\\n From the Lenders............................................... 99\\n 9.5 Reimbursement and Indemnification of Administrative Agent by\\n the Borrower................................................... 99\\n 9.6 Exculpatory Provisions; Limitation of Liability................ 100\\n 9.7 Reimbursement and Indemnification of Administrative Agent by\\n Lenders........................................................ 101\\n 9.8 Reliance by Administrative Agent............................... 101\\n 9.9 Notice of Default.............................................. 102\\n 9.10 Notices........................................................ 102\\n 9.11 Lenders in Their Individual Capacities; Administrative Agent in\\n its Individual Capacity........................................ 102\\n 9.12 Holders of Notes............................................... 102\\n 9.13 Sharing of Payments............................................ 103\\n 9.14 Successor Administrative Agent................................. 103\\n 9.15 Administrative Agent's Fee..................................... 104\\n 9.16 Availability of Funds.......................................... 104\\n 9.17 Calculations................................................... 104\\n 9.18 No Reliance on Administrative Agent's Customer Identification\\n Program........................................................ 105\\n 9.19 Beneficiaries.................................................. 105\\n\\n\\n\\n -vi-\\n\\n\\n\\n TABLE OF CONTENTS\\n\\n\\n\\nSection Page\\n------- ----\\n \\n10. MISCELLANEOUS........................................................ 105\\n 10.1 Modifications, Amendments or Waivers........................... 105\\n 10.1.1 Increase of Commitment................................. 105\\n 10.1.2 Extension of Payment; Reduction of Principal Interest\\n or Fees................................................ 106\\n 10.1.3 Release a Guarantor.................................... 106\\n 10.1.4 Miscellaneous.......................................... 106\\n 10.2 No Implied Waivers; Cumulative Remedies; Writing Required...... 106\\n 10.3 Reimbursement and Indemnification of Lenders by the Borrower... 107\\n 10.4 Holidays....................................................... 107\\n 10.5 Funding by Branch, Subsidiary or Affiliate..................... 108\\n 10.5.1 Notional Funding....................................... 108\\n 10.5.2 Actual Funding......................................... 108\\n 10.6 Notices; Lending Offices....................................... 108\\n 10.7 Severability................................................... 109\\n 10.8 Governing Law.................................................. 110\\n 10.9 Prior Understanding............................................ 110\\n 10.10 Duration; Survival............................................. 110\\n 10.11 Successors and Assigns......................................... 110\\n 10.12 Confidentiality................................................ 112\\n 10.12.1 General................................................ 112\\n 10.12.2 Sharing Information With Affiliates of the Lenders..... 112\\n 10.13 Counterparts................................................... 113\\n 10.14 Administrative Agent's or Lender's Consent..................... 113\\n 10.15 Exceptions..................................................... 113\\n 10.16 CONSENT TO FORUM; WAIVER OF JURY TRIAL......................... 113\\n 10.17 Certifications From Lenders and Participants................... 114\\n 10.17.1 Tax Withholding........................................ 114\\n 10.17.2 USA Patriot Act........................................ 115\\n 10.18 Nature of Foreign Borrower Obligations......................... 115\\n 10.19 Pledge of Foreign Loan Party Loans............................. 116\\n\\n\\n\\n -vii-\\n\\n\\n\\n LIST OF SCHEDULES AND EXHIBITS\\n\\nSCHEDULES\\nSCHEDULE 1.1(A) - PRICING GRID\\nSCHEDULE 1.1(B) - COMMITMENTS OF BANKS AND ADDRESSES FOR NOTICES\\nSCHEDULE 1.1(E) - EXISTING LETTERS OF CREDIT\\nSCHEDULE 1.1(M) - MATERIAL SUBSIDIARIES\\nSCHEDULE 1.1(P) - PERMITTED LIENS\\nSCHEDULE 5.1.1 - DOMESTIC QUALIFICATIONS TO DO BUSINESS\\nSCHEDULE 5.1.2 - SUBSIDIARIES\\nSCHEDULE 5.1.6 - LITIGATION\\nSCHEDULE 5.1.12 - CONSENTS AND APPROVALS\\nSCHEDULE 5.1.14 - PATENTS, TRADEMARKS, COPYRIGHTS, LICENSES, ETC.\\nSCHEDULE 7.2.1 - PERMITTED INDEBTEDNESS\\nSCHEDULE 7.2.4 - EXISTING INVESTMENTS\\n\\nEXHIBITS\\nEXHIBIT 1.1(A) - ASSIGNMENT AND ASSUMPTION AGREEMENT\\nEXHIBIT 1.1(B) - BORROWER JOINDER\\nEXHIBIT 1.1(G)(1) - GUARANTOR JOINDER\\nEXHIBIT 1.1(G)(2) - GUARANTY AGREEMENT\\nEXHIBIT 1.1(R) - REVOLVING CREDIT NOTE\\nEXHIBIT 1.1(S) - SWING LOAN NOTE\\nEXHIBIT 2.4 - LOAN REQUEST\\nEXHIBIT 6.1.4 - OPINION OF COUNSEL\\nEXHIBIT 7.2.6 - ACQUISITION COMPLIANCE CERTIFICATE\\nEXHIBIT 7.3.3 - QUARTERLY COMPLIANCE CERTIFICATE\\n\\n\\n -viii-\\n\\n\\n\\n CREDIT AGREEMENT\\n\\n THIS CREDIT AGREEMENT is dated as of April 29, 2010, and is made by and\\namong P.H. GLATFELTER COMPANY, a Pennsylvania corporation ( the \\\"COMPANY\\\") and\\ncertain of its subsidiaries identified on the signature pages hereto (each a\\n\\\"BORROWER\\\" and collectively, the \\\"BORROWERS\\\"), each of the GUARANTORS (as\\nhereinafter defined), the LENDERS (as hereinafter defined), PNC BANK, NATIONAL\\nASSOCIATION, in its capacity as agent for the Lenders under this Agreement\\n(hereinafter referred to in such capacity as the \\\"ADMINISTRATIVE AGENT\\\"), and,\\nfor the limited purpose of public identification in trade tables, PNC CAPITAL\\nMARKETS LLC and CITIZENS BANK OF PENNSYLVANIA, as joint arrangers and joint\\nbookrunners, and CITIZENS BANK OF PENNSYLVANIA, as syndication agent.\\n\\n WITNESSETH:\\n\\n WHEREAS, the Borrowers have requested the Lenders to provide a revolving\\ncredit facility to the Borrowers in an aggregate principal amount not to exceed\\n$225,000,000; and\\n\\n WHEREAS, proceeds of the revolving credit facility shall be used for (1)\\nrefinancing existing Indebtedness, and (2) general corporate purposes; and\\n\\n WHEREAS, the Lenders are willing to provide such credit upon the terms and\\nconditions hereinafter set forth;\\n\\n NOW, THEREFORE, the parties hereto, in consideration of their mutual\\ncovenants and agreements hereinafter set forth and intending to be legally bound\\nhereby, covenant and agree as follows:\\n\\n 1. CERTAIN DEFINITIONS\\n\\n 1.1 CERTAIN DEFINITIONS.\\n\\n In addition to words and terms defined elsewhere in this Agreement,\\nthe following words and terms shall have the following meanings, respectively,\\nunless the context hereof clearly requires otherwise:\\n\\n 2006 SENIOR NOTES shall mean the Company's 7 ?% senior notes,\\nissued in 2006 and due May 1, 2016, in the aggregate principal amount of\\n$200,000,000, guarantied by certain of the Loan Parties.\\n\\n 2010 SENIOR NOTES shall mean the Company's 7 ?% senior notes,\\nissued in 2010 and due May 1, 2016, in the aggregate principal amount of\\n$100,000,000, guarantied by certain of the Loan Parties.\\n\\n ACCOUNTS RECEIVABLE FACILITY DOCUMENTS means all documentation\\nentered into by the Company and its Subsidiaries, including, without limitation,\\nthe Receivables Entity, in connection with the sale or other transfer of\\naccounts receivable and other related assets pursuant to a Permitted Accounts\\nReceivable Program, as such documentation may be\\n\\n\\n\\namended, restated, supplemented or otherwise modified from time to time in\\naccordance with the terms hereof and thereof.\\n\\n ADMINISTRATIVE AGENT shall have the meaning given to such term in\\nthe introductory paragraph hereof.\\n\\n ADMINISTRATIVE AGENT'S FEE shall have the meaning assigned to\\nthat term in Section 9.15.\\n\\n ADMINISTRATIVE AGENT'S LETTER shall have the meaning assigned to\\nthat term in Section 9.15.\\n\\n AFFILIATE as to any Person shall mean any other Person (i) which,\\ndirectly or indirectly controls, is controlled by, or is under common control\\nwith such Person. For purposes of this definition, \\\"control\\\" (including, with\\ncorrelative meanings, the term \\\"controlled by\\\" and \\\"under common control with\\\")\\nshall mean the power, directly or indirectly, either to (a) vote 10% or more of\\nthe securities having ordinary voting power for the election of directors of\\nsuch Person or (b) direct or cause the direction of the management and policies\\nof such Person whether through the ownership of voting securities or by contract\\nor otherwise, including the power to elect a majority of the directors of a\\ncorporation.\\n\\n AGREEMENT shall mean this Credit Agreement, as the same may be\\nextended, renewed, amended, supplemented or restated from time to time,\\nincluding all schedules and exhibits.\\n\\n ANTI-TERRORISM LAWS shall mean any Laws relating to terrorism or\\nmoney laundering, including Executive Order No. 13224, the USA Patriot Act, the\\nLaws comprising or implementing the Bank Secrecy Act, and the Laws administered\\nby the United States Treasury Department's Office of Foreign Asset Control (as\\nany of the foregoing Laws may from time to time be amended, renewed, extended,\\nor replaced).\\n\\n APPLICABLE COMMITMENT FEE RATE shall mean the percentage rate per\\nannum at the indicated level of Debt Rating in the pricing grid on SCHEDULE\\n1.1(A) next to the line titled \\\"Commitment Fee.\\\" The Applicable Commitment Fee\\nRate shall be computed in accordance with the parameters set forth on SCHEDULE\\n1.1(A).\\n\\n APPLICABLE MARGIN shall mean the percentage spread to be added to\\nEuro-Rate under the Euro-Rate Option or to the Base Rate under the Base Rate\\nOption at the indicated level of Debt Rating in the pricing grid on SCHEDULE\\n1.1(A) next to the line titled \\\"Euro-Rate Spread\\\" or \\\"Base Rate Spread.\\\" The\\nApplicable Margin shall be computed in accordance with the parameters set forth\\non SCHEDULE 1.1(A).\\n\\n ASSIGNMENT AND ASSUMPTION AGREEMENT shall mean an Assignment and\\nAssumption Agreement by and among a Purchasing Lender, a Transferor Lender and\\nthe Administrative Agent, as Administrative Agent and on behalf of the remaining\\nLenders, substantially in the form of EXHIBIT 1.1(A).\"\n",
" ],\n",
" \"category\": [\n",
" \"credit-agreement\"\n",
" ]\n",
" },\n",
" {\n",
" \"document\": [\n",
" \"AUGMENTING LENDER shall have the meaning assigned to such term in\\nSection 2.1.1.2.\\n\\n AUTHORIZED OFFICER shall mean those individuals, designated by\\nwritten notice to the Administrative Agent from the Company, on behalf of all\\nthe Loan Parties, authorized to execute notices, reports and other documents on\\nbehalf of the Loan Parties required hereunder. The Company, on behalf of all the\\nLoan Parties, may amend such list of individuals from time to time by giving\\nwritten notice of such amendment to the Administrative Agent.\\n\\n BASE RATE shall mean the greater of (i) the interest rate per\\nannum announced from time to time by the Administrative Agent at its Principal\\nOffice as its then prime rate, which rate may not be the lowest rate then being\\ncharged to commercial borrowers by the Administrative Agent, (ii) the Federal\\nFunds Open Rate plus 0.5% per annum, or (iii) the Daily Euro-Rate plus 1.00% per\\nannum.\\n\\n BASE RATE OPTION shall mean the option of the Borrowers to have\\nLoans bear interest at the rate and under the terms and conditions set forth in\\nSection 3.1.1(i).\\n\\n BENEFIT ARRANGEMENT shall mean at any time an \\\"employee benefit\\nplan,\\\" within the meaning of Section 3(3) of ERISA, which is neither a Plan nor\\na Multiemployer Plan and which is maintained, sponsored or otherwise contributed\\nto by any member of the ERISA Group.\\n\\n BLOCKED PERSON shall have the meaning assigned to such term in\\nSection 5.1.23.2.\\n\\n BORROWER shall have the meaning given to such term in the\\nintroductory paragraph hereto and shall include any Person required to join this\\nAgreement pursuant to Section 7.2.9 or which elects to join this agreement as a\\nBorrower and, in each case, executes a Borrower Joinder.\\n\\n BORROWER JOINDER shall mean a joinder by a Person as a Borrower\\nunder this Agreement and the other Loan Documents in substantially the form of\\nEXHIBIT 1.1(B).\\n\\n BORROWING DATE shall mean, with respect to any Loan, the date for\\nthe making thereof or the renewal or conversion thereof at the same or a\\ndifferent Interest Rate Option, which shall be a Business Day.\\n\\n BORROWING TRANCHE shall mean specified portions of Loans\\noutstanding as follows: (i) any Loans to which a Euro-Rate Option applies which\\nbecome subject to the same Interest Rate Option under the same Loan Request by\\nthe Borrowers and which have the same Interest Period and which are denominated\\neither in Dollars or in the same Optional Currency shall constitute one\\nBorrowing Tranche, and (ii) all Loans to which a Base Rate Option applies shall\\nconstitute one Borrowing Tranche.\"\n",
" ],\n",
" \"sentence_embeddings\": [\n",
" \"AUGMENTING LENDER shall have the meaning assigned to such term in\\nSection 2.1.1.2.\\n\\n AUTHORIZED OFFICER shall mean those individuals, designated by\\nwritten notice to the Administrative Agent from the Company, on behalf of all\\nthe Loan Parties, authorized to execute notices, reports and other documents on\\nbehalf of the Loan Parties required hereunder. The Company, on behalf of all the\\nLoan Parties, may amend such list of individuals from time to time by giving\\nwritten notice of such amendment to the Administrative Agent.\\n\\n BASE RATE shall mean the greater of (i) the interest rate per\\nannum announced from time to time by the Administrative Agent at its Principal\\nOffice as its then prime rate, which rate may not be the lowest rate then being\\ncharged to commercial borrowers by the Administrative Agent, (ii) the Federal\\nFunds Open Rate plus 0.5% per annum, or (iii) the Daily Euro-Rate plus 1.00% per\\nannum.\\n\\n BASE RATE OPTION shall mean the option of the Borrowers to have\\nLoans bear interest at the rate and under the terms and conditions set forth in\\nSection 3.1.1(i).\\n\\n BENEFIT ARRANGEMENT shall mean at any time an \\\"employee benefit\\nplan,\\\" within the meaning of Section 3(3) of ERISA, which is neither a Plan nor\\na Multiemployer Plan and which is maintained, sponsored or otherwise contributed\\nto by any member of the ERISA Group.\\n\\n BLOCKED PERSON shall have the meaning assigned to such term in\\nSection 5.1.23.2.\\n\\n BORROWER shall have the meaning given to such term in the\\nintroductory paragraph hereto and shall include any Person required to join this\\nAgreement pursuant to Section 7.2.9 or which elects to join this agreement as a\\nBorrower and, in each case, executes a Borrower Joinder.\\n\\n BORROWER JOINDER shall mean a joinder by a Person as a Borrower\\nunder this Agreement and the other Loan Documents in substantially the form of\\nEXHIBIT 1.1(B).\\n\\n BORROWING DATE shall mean, with respect to any Loan, the date for\\nthe making thereof or the renewal or conversion thereof at the same or a\\ndifferent Interest Rate Option, which shall be a Business Day.\\n\\n BORROWING TRANCHE shall mean specified portions of Loans\\noutstanding as follows: (i) any Loans to which a Euro-Rate Option applies which\\nbecome subject to the same Interest Rate Option under the same Loan Request by\\nthe Borrowers and which have the same Interest Period and which are denominated\\neither in Dollars or in the same Optional Currency shall constitute one\\nBorrowing Tranche, and (ii) all Loans to which a Base Rate Option applies shall\\nconstitute one Borrowing Tranche.\"\n",
" ],\n",
" \"category\": [\n",
" \"other\"\n",
" ]\n",
" },\n",
" {\n",
" \"document\": [\n",
" \"DECLINED SHARE shall have the meaning assigned to that term in\\nSection 2.1.1.2.\\n\\n DEFAULTING LENDER shall have the meaning assigned to that term in\\nSection 4.4.2.\\n\\n DESIGNATED CREDIT PARTIES means the Company and those\\nSubsidiaries that are from time to time party to the Accounts Receivable\\nFacility Documents.\\n\\n DOLLAR, DOLLARS, U.S. DOLLARS and the symbol $ shall mean lawful\\nmoney of the United States of America.\\n\\n DOLLAR EQUIVALENT shall mean, with respect to any amount of any\\ncurrency, the Equivalent Amount of such currency expressed in Dollars.\\n\\n DOLLAR EQUIVALENT REVOLVING FACILITY USAGE shall mean, at any\\ntime, the sum of the Dollar Equivalent of the principal amount of Revolving\\nCredit Loans then outstanding and the principal amount of Swing Loans then\\noutstanding and the Dollar Equivalent amount of Letters of Credit Outstanding.\\n\\n DOMESTIC GUARANTOR shall mean those Guarantors which are\\norganized under the laws of the United States.\\n\\n DRAWING DATE shall have the meaning assigned to that term in\\nSection 2.11.3.2.\\n\\n EBITDA shall mean, for any period and any Person, net income\\n(excluding gains and losses on sales of assets (with the exception of sales of\\ntimberland property noted in the definition of Consolidated EBITDA)) and\\nnon-cash pension income and non-cash pension expenses) plus income tax expense,\\ninterest expense (excluding Timberland Installment Sale Interest Expense),\\ndepreciation, amortization expense and any Permitted EBITDA Add Backs (if\\nConsolidated EBITDA is being computed for the Company) of such Person.\\n\\n ENGLISH BORROWER shall mean any Borrower organized under the Laws\\nof England and Wales.\\n\\n ENVIRONMENTAL COMPLAINT shall mean any written complaint by any\\nPerson or Official Body setting forth a cause of action for personal injury or\\nproperty damage, natural resource damage, contribution or indemnity for response\\ncosts, civil or administrative penalties, criminal fines or penalties, or\\ndeclaratory or equitable relief arising under any Environmental Laws or any\\norder, notice of violation, citation, subpoena, request for information or other\\nwritten notice or demand of any type issued by an Official Body pursuant to any\\nEnvironmental Laws.\\n\\n ENVIRONMENTAL LAWS shall mean all applicable federal, state,\\nlocal and foreign Laws and any legally binding consent decrees, settlement\\nagreements, judgments, orders\"\n",
" ],\n",
" \"sentence_embeddings\": [\n",
" \"DECLINED SHARE shall have the meaning assigned to that term in\\nSection 2.1.1.2.\\n\\n DEFAULTING LENDER shall have the meaning assigned to that term in\\nSection 4.4.2.\\n\\n DESIGNATED CREDIT PARTIES means the Company and those\\nSubsidiaries that are from time to time party to the Accounts Receivable\\nFacility Documents.\\n\\n DOLLAR, DOLLARS, U.S. DOLLARS and the symbol $ shall mean lawful\\nmoney of the United States of America.\\n\\n DOLLAR EQUIVALENT shall mean, with respect to any amount of any\\ncurrency, the Equivalent Amount of such currency expressed in Dollars.\\n\\n DOLLAR EQUIVALENT REVOLVING FACILITY USAGE shall mean, at any\\ntime, the sum of the Dollar Equivalent of the principal amount of Revolving\\nCredit Loans then outstanding and the principal amount of Swing Loans then\\noutstanding and the Dollar Equivalent amount of Letters of Credit Outstanding.\\n\\n DOMESTIC GUARANTOR shall mean those Guarantors which are\\norganized under the laws of the United States.\\n\\n DRAWING DATE shall have the meaning assigned to that term in\\nSection 2.11.3.2.\\n\\n EBITDA shall mean, for any period and any Person, net income\\n(excluding gains and losses on sales of assets (with the exception of sales of\\ntimberland property noted in the definition of Consolidated EBITDA)) and\\nnon-cash pension income and non-cash pension expenses) plus income tax expense,\\ninterest expense (excluding Timberland Installment Sale Interest Expense),\\ndepreciation, amortization expense and any Permitted EBITDA Add Backs (if\\nConsolidated EBITDA is being computed for the Company) of such Person.\\n\\n ENGLISH BORROWER shall mean any Borrower organized under the Laws\\nof England and Wales.\\n\\n ENVIRONMENTAL COMPLAINT shall mean any written complaint by any\\nPerson or Official Body setting forth a cause of action for personal injury or\\nproperty damage, natural resource damage, contribution or indemnity for response\\ncosts, civil or administrative penalties, criminal fines or penalties, or\\ndeclaratory or equitable relief arising under any Environmental Laws or any\\norder, notice of violation, citation, subpoena, request for information or other\\nwritten notice or demand of any type issued by an Official Body pursuant to any\\nEnvironmental Laws.\\n\\n ENVIRONMENTAL LAWS shall mean all applicable federal, state,\\nlocal and foreign Laws and any legally binding consent decrees, settlement\\nagreements, judgments, orders\"\n",
" ],\n",
" \"category\": [\n",
" \"other\"\n",
" ]\n",
" },\n",
" {\n",
" \"document\": [\n",
" \"EURO-RATE OPTION shall mean the option of the Borrowers to have\\nLoans bear interest at the rate and under the terms and conditions set forth in\\nSection 3.1.1(ii).\\n\\n EURO-RATE RESERVE PERCENTAGE shall mean as of any day the maximum\\npercentage in effect on such day, (i) as prescribed by the Board of Governors of\\nthe Federal Reserve System (or any successor) for determining the reserve\\nrequirements (including supplemental, marginal and emergency reserve\\nrequirements) with respect to eurocurrency funding (currently referred to as\\n\\\"EUROCURRENCY LIABILITIES\\\"); and (ii) to be maintained by a Lender as required\\nfor reserve liquidity, special deposit, or similar purpose by any governmental\\nor monetary authority of any country or political subdivision thereof (including\\nany central bank), against (A) any category of liabilities that includes\\ndeposits by reference to which a Euro-Rate is to be determined, or (B) any\\ncategory of extension of credit or other assets that includes Loans or Borrowing\\nTranches to which a Euro-Rate applies.\\n\\n EVENT OF DEFAULT shall mean any of the events described in\\nSection 8.1 and referred to therein as an \\\"Event of Default.\\\"\\n\\n EXECUTIVE ORDER NO. 13224 shall mean the Executive Order No.\\n13224 on Terrorist Financing, effective September 24, 2001, as the same has\\nbeen, or shall hereafter be, renewed, extended, amended or replaced.\\n\\n EXISTING LETTERS OF CREDIT shall mean those letters of credit\\nissued by PNC Bank or another Lender prior to the Closing Date as described on\\nSCHEDULE 1.1(E) attached hereto; provided that the Loan Parties will cause those\\nletters of credit issued by Lenders other than PNC Bank, as they expire, to be\\nreplaced by letters of credit issued by PNC Bank under Section 2.11.\\n\\n EXPIRATION DATE shall mean, with respect to the Revolving Credit\\nCommitments, May 31, 2014.\\n\\n FACILITY SHARE shall mean for any Lender, the Revolving Credit\\nCommitment of such Lender.\\n\\n FEDERAL FUNDS EFFECTIVE RATE for any day shall mean the rate per\\nannum (based on a year of 360 days and actual days elapsed and rounded upward to\\nthe nearest 1/100 of 1%) announced by the Federal Reserve Bank of New York (or\\nany successor) on such day as being the weighted average of the rates on\\novernight federal funds transactions arranged by federal funds brokers on the\\nprevious trading day, as computed and announced by such Federal Reserve Bank (or\\nany successor) in substantially the same manner as such Federal Reserve Bank\\ncomputes and announces the weighted average it refers to as the \\\"Federal Funds\\nEffective Rate\\\" as of the date of this Agreement; provided, if such Federal\\nReserve Bank (or its successor) does not announce such rate on any day, the\\n\\\"Federal Funds Effective Rate\\\" for such day shall be the Federal Funds Effective\\nRate for the last day on which such rate was announced.\\n\\n FEDERAL FUNDS OPEN RATE for any day shall mean the rate per annum\\n(based on a year of 360 days and the actual days elapsed) which is the daily\\nfederal funds open\"\n",
" ],\n",
" \"sentence_embeddings\": [\n",
" \"EURO-RATE OPTION shall mean the option of the Borrowers to have\\nLoans bear interest at the rate and under the terms and conditions set forth in\\nSection 3.1.1(ii).\\n\\n EURO-RATE RESERVE PERCENTAGE shall mean as of any day the maximum\\npercentage in effect on such day, (i) as prescribed by the Board of Governors of\\nthe Federal Reserve System (or any successor) for determining the reserve\\nrequirements (including supplemental, marginal and emergency reserve\\nrequirements) with respect to eurocurrency funding (currently referred to as\\n\\\"EUROCURRENCY LIABILITIES\\\"); and (ii) to be maintained by a Lender as required\\nfor reserve liquidity, special deposit, or similar purpose by any governmental\\nor monetary authority of any country or political subdivision thereof (including\\nany central bank), against (A) any category of liabilities that includes\\ndeposits by reference to which a Euro-Rate is to be determined, or (B) any\\ncategory of extension of credit or other assets that includes Loans or Borrowing\\nTranches to which a Euro-Rate applies.\\n\\n EVENT OF DEFAULT shall mean any of the events described in\\nSection 8.1 and referred to therein as an \\\"Event of Default.\\\"\\n\\n EXECUTIVE ORDER NO. 13224 shall mean the Executive Order No.\\n13224 on Terrorist Financing, effective September 24, 2001, as the same has\\nbeen, or shall hereafter be, renewed, extended, amended or replaced.\\n\\n EXISTING LETTERS OF CREDIT shall mean those letters of credit\\nissued by PNC Bank or another Lender prior to the Closing Date as described on\\nSCHEDULE 1.1(E) attached hereto; provided that the Loan Parties will cause those\\nletters of credit issued by Lenders other than PNC Bank, as they expire, to be\\nreplaced by letters of credit issued by PNC Bank under Section 2.11.\\n\\n EXPIRATION DATE shall mean, with respect to the Revolving Credit\\nCommitments, May 31, 2014.\\n\\n FACILITY SHARE shall mean for any Lender, the Revolving Credit\\nCommitment of such Lender.\\n\\n FEDERAL FUNDS EFFECTIVE RATE for any day shall mean the rate per\\nannum (based on a year of 360 days and actual days elapsed and rounded upward to\\nthe nearest 1/100 of 1%) announced by the Federal Reserve Bank of New York (or\\nany successor) on such day as being the weighted average of the rates on\\novernight federal funds transactions arranged by federal funds brokers on the\\nprevious trading day, as computed and announced by such Federal Reserve Bank (or\\nany successor) in substantially the same manner as such Federal Reserve Bank\\ncomputes and announces the weighted average it refers to as the \\\"Federal Funds\\nEffective Rate\\\" as of the date of this Agreement; provided, if such Federal\\nReserve Bank (or its successor) does not announce such rate on any day, the\\n\\\"Federal Funds Effective Rate\\\" for such day shall be the Federal Funds Effective\\nRate for the last day on which such rate was announced.\\n\\n FEDERAL FUNDS OPEN RATE for any day shall mean the rate per annum\\n(based on a year of 360 days and the actual days elapsed) which is the daily\\nfederal funds open\"\n",
" ],\n",
" \"category\": [\n",
" \"other\"\n",
" ]\n",
" }\n",
"]\n"
]
}
],
"source": [
"json_res = lp.annotate( [ pages[0], pages[1], pages[5], pages[9]] )\n",
"print(json.dumps(json_res, indent=4))"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "4LwNwtTv5uA8"
},
"source": [
"Ok our classifiers, which work on the top 512 tokens, say we have a **10K document** by using the first page."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "zSw7YQfS5vic"
},
"source": [
"#โ๏ธ 1.4. Paragraph / Section / Items splitting"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "U-A2PTjaSJRM"
},
"source": [
"## TextSplitter\n",
"To split by sentences or paragraphs or ..."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "6rQdecRWDvkr"
},
"source": [
"In most cases:\n",
"- paragraphs can be extracted using just `\\n\\n`.\n",
"- sections and items may be delimited by headers and subheaders. We can train DL models to detect them or, if use numeration (if theyu are numerated sections) or other patterns to delimit their boundaries\n"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "c4ywgRBu3pq0"
},
"outputs": [],
"source": [
"example1 = \"\"\"Exhibit 10.2\n",
"\n",
"Execution Version\n",
"\n",
"INTELLECTUAL PROPERTY AGREEMENT\n",
"\n",
"This INTELLECTUAL PROPERTY AGREEMENT (this \"Agreement\"), dated as of December 31, 2018 (the \"Effective Date\") is entered into by and between Armstrong Flooring, Inc., a Delaware corporation (\"Seller\") and AFI Licensing LLC, a Delaware limited liability company (\"Licensing\" and together with Seller, \"Arizona\") and AHF Holding, Inc. (formerly known as Tarzan HoldCo, Inc.), a Delaware corporation (\"Buyer\") and Armstrong Hardwood Flooring Company, a Tennessee corporation (the \"Company\" and together with Buyer the \"Buyer Entities\") (each of Arizona on the one hand and the Buyer Entities on the other hand, a \"Party\" and collectively, the \"Parties\").\n",
"\n",
"WHEREAS, Seller and Buyer have entered into that certain Stock Purchase Agreement, dated November 14, 2018 (the \"Stock Purchase Agreement\"); WHEREAS, pursuant to the...\"\"\""
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "9jerVCQuF24v"
},
"source": [
"By `\\n\\n`..."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "SxWYrFuBElq4",
"outputId": "b0a5b8b3-f68c-4a3b-dc2a-eafac05d7f27"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+--------------------+\n",
"| result|\n",
"+--------------------+\n",
"| [Exhibit 10.2]|\n",
"| [Execution Version]|\n",
"|[INTELLECTUAL PRO...|\n",
"|[This INTELLECTUA...|\n",
"|[WHEREAS, Seller ...|\n",
"+--------------------+\n",
"\n"
]
}
],
"source": [
"text_splitter = legal.TextSplitter() \\\n",
" .setInputCols([\"document\"]) \\\n",
" .setOutputCol(\"paragraphs\")\\\n",
" .setCustomBounds([\"\\n\\n\"])\\\n",
" .setUseCustomBoundsOnly(True)\\\n",
" .setExplodeSentences(True)\n",
"\n",
"nlp_pipeline = nlp.Pipeline(stages=[\n",
" document_assembler,\n",
" text_splitter])\n",
"\n",
"sdf = spark.createDataFrame([[ example1 ]]).toDF(\"text\")\n",
"\n",
"fit = nlp_pipeline.fit(sdf)\n",
"res = fit.transform(sdf)\n",
"\n",
"res = res.select('paragraphs.result').show()"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "gAjPslKQEu6K",
"outputId": "51add0fc-5366-42dd-cc7d-aa471674aa76"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+--------------------+\n",
"| result|\n",
"+--------------------+\n",
"| [Exhibit 10.2]|\n",
"| [Execution Version]|\n",
"|[INTELLECTUAL PRO...|\n",
"|[This INTELLECTUA...|\n",
"|[WHEREAS, Seller ...|\n",
"+--------------------+\n",
"\n"
]
}
],
"source": [
"text_splitter = legal.TextSplitter() \\\n",
" .setInputCols([\"document\"]) \\\n",
" .setOutputCol(\"paragraphs\")\\\n",
" .setCustomBounds([\"\\n\\n\"])\\\n",
" .setUseCustomBoundsOnly(True)\\\n",
" .setExplodeSentences(True)\n",
"\n",
"nlp_pipeline = nlp.Pipeline(stages=[\n",
" document_assembler,\n",
" text_splitter])\n",
"\n",
"sdf = spark.createDataFrame([[ example1 ]]).toDF(\"text\")\n",
"\n",
"fit = nlp_pipeline.fit(sdf)\n",
"res = fit.transform(sdf)\n",
"\n",
"res = res.select('paragraphs.result').show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "m_3ueCfRF8Kw"
},
"source": [
"By other regular expressions ..."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "tr0P_O5JEiSH"
},
"outputs": [],
"source": [
"example2 = \"\"\"\n",
"4. GRANT OF KNOW-HOW LICENSE \n",
"4.1 Arizona Know-How Grant. Subject to the terms and conditions of this Agreement, Arizona hereby grants to the Company a perpetual, non- exclusive, royalty-free license in, to and under the Arizona Licensed Know-How for use in the Company Field throughout the world. \n",
"4.2 Company Know-How Grant. Subject to the terms and conditions of this Agreement, the Company hereby grants to Seller a perpetual, non- exclusive, royalty-free license in, to and under the Company Licensed Know-How for use in the Arizona Field throughout the world. \n",
"5. GRANT OF PATENT LICENSE \n",
"5.1 Arizona Patent Grant. Subject to the terms and conditions of this Agreement, Arizona hereby grants to the Company a perpetual, non-exclusive, royalty-free license in, to and under the Arizona Licensed Patents for use in the Company Field throughout the world.\n",
"\"\"\""
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "hjerJLEeGCC_",
"outputId": "ef334eca-8ef2-4e8c-e4e3-392c7bfa6645"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+--------------------+\n",
"| result|\n",
"+--------------------+\n",
"|[GRANT OF KNOW-HO...|\n",
"|[Arizona Know-How...|\n",
"|[Company Know-How...|\n",
"|[GRANT OF PATENT ...|\n",
"|[Arizona Patent G...|\n",
"+--------------------+\n",
"\n"
]
}
],
"source": [
"text_splitter = legal.TextSplitter() \\\n",
" .setInputCols([\"document\"]) \\\n",
" .setOutputCol(\"paragraphs\")\\\n",
" .setCustomBounds([\"\\n\\d\\.?\\d? \"])\\\n",
" .setUseCustomBoundsOnly(True)\\\n",
" .setExplodeSentences(True)\n",
"\n",
"nlp_pipeline = nlp.Pipeline(stages=[\n",
" document_assembler,\n",
" text_splitter])\n",
"\n",
"sdf = spark.createDataFrame([[ example2 ]]).toDF(\"text\")\n",
"\n",
"fit = nlp_pipeline.fit(sdf)\n",
"res = fit.transform(sdf)\n",
"\n",
"res = res.select('paragraphs.result').show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "HD2G0YtMGKdG"
},
"source": [
"BE CAREFUL. If you use a pattern to split and you want it to be included, use `setCustomBoundsStrategy` to `prepend` (goes as the first part of the next section) or `append` (goes as a last part of the previous section)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "OxNP2YZIGiad",
"outputId": "732b5254-36ac-43ed-a439-84b6d914f692"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+--------------------+\n",
"| result|\n",
"+--------------------+\n",
"|[4. GRANT OF KNOW...|\n",
"|[4.1 Arizona Know...|\n",
"|[4.2 Company Know...|\n",
"|[5. GRANT OF PATE...|\n",
"|[5.1 Arizona Pate...|\n",
"+--------------------+\n",
"\n"
]
}
],
"source": [
"text_splitter = legal.TextSplitter() \\\n",
" .setInputCols([\"document\"]) \\\n",
" .setOutputCol(\"paragraphs\")\\\n",
" .setCustomBounds([\"\\n\\d\\.?\\d? \"])\\\n",
" .setCustomBoundsStrategy('prepend')\\\n",
" .setUseCustomBoundsOnly(True)\\\n",
" .setExplodeSentences(True)\n",
"\n",
"nlp_pipeline = nlp.Pipeline(stages=[\n",
" document_assembler,\n",
" text_splitter])\n",
"\n",
"sdf = spark.createDataFrame([[ example2 ]]).toDF(\"text\")\n",
"\n",
"fit = nlp_pipeline.fit(sdf)\n",
"res = fit.transform(sdf)\n",
"\n",
"res = res.select('paragraphs.result').show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "XbFyZvlmSSdc"
},
"source": [
"## Using NER and ChunkSentenceSplitter\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "-VvRsuKIHzCl"
},
"source": [
"... using pretrained NER models for `Headers and Subheaders`"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "cGvILozB3pq0",
"outputId": "2ea7f86f-f22c-431e-e3c3-f5fda62c06a8"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"sentence_detector_dl download started this may take some time.\n",
"Approximate size to download 514.9 KB\n",
"[OK!]\n",
"roberta_embeddings_legal_roberta_base download started this may take some time.\n",
"Approximate size to download 447.2 MB\n",
"[OK!]\n",
"legner_headers download started this may take some time.\n",
"[OK!]\n"
]
}
],
"source": [
"documentAssembler = nlp.DocumentAssembler()\\\n",
" .setInputCol(\"text\")\\\n",
" .setOutputCol(\"document\")\n",
" \n",
"sentenceDetector = nlp.SentenceDetectorDLModel.pretrained(\"sentence_detector_dl\",\"xx\")\\\n",
" .setInputCols([\"document\"])\\\n",
" .setOutputCol(\"sentence\")\n",
"\n",
"tokenizer = nlp.Tokenizer()\\\n",
" .setInputCols([\"sentence\"])\\\n",
" .setOutputCol(\"token\")\n",
"\n",
"embeddings = nlp.RoBertaEmbeddings.pretrained(\"roberta_embeddings_legal_roberta_base\",\"en\") \\\n",
" .setInputCols([\"sentence\", \"token\"]) \\\n",
" .setOutputCol(\"embeddings\")\n",
"\n",
"ner_model = legal.NerModel.pretrained(\"legner_headers\", \"en\", \"legal/models\")\\\n",
" .setInputCols([\"sentence\", \"token\", \"embeddings\"])\\\n",
" .setOutputCol(\"ner\")\n",
"\n",
"ner_converter = nlp.NerConverter()\\\n",
" .setInputCols([\"sentence\",\"token\",\"ner\"])\\\n",
" .setOutputCol(\"ner_chunk\")\n",
"\n",
"nlp_pipeline = nlp.Pipeline(stages=[\n",
" documentAssembler,\n",
" sentenceDetector,\n",
" tokenizer,\n",
" embeddings,\n",
" ner_model,\n",
" ner_converter])"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "uUAZCN500SAA"
},
"outputs": [],
"source": [
"text = \"\"\"AGREEMENT\n",
"\n",
"NOW, THEREFORE, for good and valuable consideration, and in consideration of the mutual covenants and conditions herein contained, the Parties agree as follows:\n",
"\n",
"2. Definitions. For purposes of this Agreement, the following terms have the meanings ascribed thereto in this Section 1. 2. Appointment as Reseller.\n",
"\n",
"2.1 Appointment. The Company hereby [***]. Allscripts may also disclose Company's pricing information relating to its Merchant Processing Services and facilitate procurement of Merchant Processing Services on behalf of Sublicensed Customers, including, without limitation by references to such pricing information and Merchant Processing Services in Customer Agreements. 6\n",
"\n",
"2.2 Customer Agreements.\n",
"\n",
"a) Subscriptions. Allscripts and its Affiliates may sell Subscriptions for terms no less than one year and no greater than four (4) years on a subscription basis to Persons who subsequently execute a Customer Agreement, provided that Allscripts may enter into Customer Agreements with terms longer than four (4) years with large organizations, provided that Phreesia consents in each instance in writing in advance, which consent will not be unreasonably withheld.\"\"\"\n"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "mGV53Qg43pq0"
},
"outputs": [],
"source": [
"sdf = spark.createDataFrame([[ text ]]).toDF(\"text\")\n",
"\n",
"fit = nlp_pipeline.fit(sdf)\n",
"\n",
"lp = nlp.LightPipeline(fit)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "NtV97-ON3pq0"
},
"outputs": [],
"source": [
"res = lp.fullAnnotate(text)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 563
},
"id": "Wb32X3CGImZU",
"outputId": "15cdfefb-4061-4fd9-8345-33c394cb685f"
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
" AGREEMENT HEADER
NOW, THEREFORE, for good and valuable consideration, and in consideration of the mutual covenants and conditions herein contained, the Parties agree as follows:
2. Definitions HEADER. For purposes of this Agreement, the following terms have the meanings ascribed thereto in this Section 1. 2. Appointment as Reseller HEADER.
2.1 Appointment SUBHEADER. The Company hereby [***]. Allscripts may also disclose Company's pricing information relating to its Merchant Processing Services and facilitate procurement of Merchant Processing Services on behalf of Sublicensed Customers, including, without limitation by references to such pricing information and Merchant Processing Services in Customer Agreements. 6
2.2 Customer Agreements SUBHEADER.
a) Subscriptions SUBHEADER. Allscripts and its Affiliates may sell Subscriptions for terms no less than one year and no greater than four (4) years on a subscription basis to Persons who subsequently execute a Customer Agreement, provided that Allscripts may enter into Customer Agreements with terms longer than four (4) years with large organizations, provided that Phreesia consents in each instance in writing in advance, which consent will not be unreasonably withheld."
],
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"from johnsnowlabs import viz\n",
"\n",
"ner_viz = viz.NerVisualizer()\n",
"\n",
"ner_viz.display(res[0], label_col='ner_chunk')"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "Vvc7JYhP3pq1",
"outputId": "96762169-0375-4f1d-ded1-0126dc1bf0b8"
},
"outputs": [
{
"data": {
"text/plain": [
"[(0, 8), (173, 186), (295, 320), (324, 338), (698, 720), (724, 739)]"
]
},
"execution_count": 30,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"ner_res = res[0]['ner_chunk'] # Document 0\n",
"\n",
"sections = []\n",
"for ann in ner_res:\n",
" sections.append( (ann.begin, ann.end) )\n",
"sections"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "q_G81s_T3pq1"
},
"outputs": [],
"source": [
"section_texts = []\n",
"last_section = 0\n",
"last_section_name = \"\"\n",
"for s in sections:\n",
" t = last_section_name + text[last_section:s[0]]\n",
" if t != '':\n",
" section_texts.append(t) \n",
" last_section = s[1]+1\n",
" last_section_name = text[s[0]:s[1]+1]\n",
"section_texts.append(last_section_name + text[last_section:s[0]]) "
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "MQ1_gBVX3pq1"
},
"outputs": [],
"source": [
"OKGREEN = '\\033[92m'\n",
"ENDC = '\\033[0m'"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "AFEB4iUw3pq1",
"outputId": "649536ce-a819-4c9a-c493-cab7a772f0ba"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"\u001b[92mSECTION:\u001b[0m\n",
"AGREEMENT\n",
"\n",
"NOW, THEREFORE, for good and valuable consideration, and in consideration of the mutual covenants and conditions herein contained, the Parties agree as follows:\n",
"\n",
"\n",
"\u001b[92mSECTION:\u001b[0m\n",
"2. Definitions. For purposes of this Agreement, the following terms have the meanings ascribed thereto in this Section 1. \n",
"\u001b[92mSECTION:\u001b[0m\n",
"2. Appointment as Reseller.\n",
"\n",
"\n",
"\u001b[92mSECTION:\u001b[0m\n",
"2.1 Appointment. The Company hereby [***]. Allscripts may also disclose Company's pricing information relating to its Merchant Processing Services and facilitate procurement of Merchant Processing Services on behalf of Sublicensed Customers, including, without limitation by references to such pricing information and Merchant Processing Services in Customer Agreements. 6\n",
"\n",
"\n",
"\u001b[92mSECTION:\u001b[0m\n",
"2.2 Customer Agreements.\n",
"\n",
"\n",
"\u001b[92mSECTION:\u001b[0m\n",
"a) Subscriptions\n"
]
}
],
"source": [
"for t in section_texts:\n",
" print(f\"{OKGREEN}SECTION:{ENDC}\\n{t}\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "aoZwJL5BSbuz"
},
"source": [
"... or automatically using ChunkSentenceSpliting..."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "4j9qBo6qScK0"
},
"outputs": [],
"source": [
"chunkSentenceSplitter = legal.ChunkSentenceSplitter()\\\n",
" .setInputCols(\"document\",\"ner_chunk\")\\\n",
" .setOutputCol(\"paragraphs\")\\\n",
" .setGroupBySentences(False)\n",
"\n",
" \n",
"nlp_pipeline = nlp.Pipeline(stages=[\n",
" documentAssembler,\n",
" sentenceDetector,\n",
" tokenizer,\n",
" embeddings,\n",
" ner_model,\n",
" ner_converter,\n",
" chunkSentenceSplitter])\n",
"\n",
"\n",
"paragraphs = nlp_pipeline.fit(sdf).transform(sdf)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 268
},
"id": "IzdVodAxSjb0",
"outputId": "6f1c8c79-c455-470d-fa19-6d9265e0c37a"
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"
\n",
"
\n",
"
\n",
"\n",
"
\n",
" \n",
"
\n",
"
\n",
"
result
\n",
"
entity
\n",
"
\n",
" \n",
" \n",
"
\n",
"
0
\n",
"
AGREEMENT\\n\\nNOW, THEREFORE, for good and valuable consideration, and in consideration of the mutual covenants and conditions herein contained, the Parties agree as follows:\\n\\n
\n",
"
HEADER
\n",
"
\n",
"
\n",
"
1
\n",
"
2. Definitions. For purposes of this Agreement, the following terms have the meanings ascribed thereto in this Section 1.
\n",
"
HEADER
\n",
"
\n",
"
\n",
"
2
\n",
"
2. Appointment as Reseller.\\n\\n
\n",
"
HEADER
\n",
"
\n",
"
\n",
"
3
\n",
"
2.1 Appointment. The Company hereby [***]. Allscripts may also disclose Company's pricing information relating to its Merchant Processing Services and facilitate procurement of Merchant Processing Services on behalf of Sublicensed Customers, including, without limitation by references to such pricing information and Merchant Processing Services in Customer Agreements. 6\\n\\n
For purposes of this Agreement, the following terms have the meanings ascribed thereto in this Section 1 and 2 Appointment as Reseller.
2.1 Appointment SUBHEADER.
The Company hereby [***]. Allscripts may also disclose Company's pricing information relating to its Merchant Processing Services and facilitate procurement of Merchant Processing Services on behalf of Sublicensed Customers, including, without limitation by references to such pricing information and Merchant Processing Services in Customer Agreements. 6
2.2 Customer Agreements SUBHEADER."
]
},
"metadata": {}
}
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "rejTgU8LIdok"
},
"source": [
"#โ๏ธ 1.5. Paragraph Classification and the consequences of splitting"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "SdQEusv7KJ4U"
},
"source": [
""
]
},
{
"cell_type": "markdown",
"metadata": {
"collapsed": false,
"id": "UR_JGuKp3pqw"
},
"source": [
"\n",
"In Legal NLP we have more than 350 classifiers which you can use to detect specific clauses in your documents. You can find them in Models Hub, where they all end with `_clause`\n",
"\n",
"```\n",
"...\n",
"- legclf_indemnification_clause\n",
"- legclf_insolvency_clause\n",
"- legclf_whereas_clause\n",
"- legclf_indebtedness_clause\n",
"- legclf_in_witness_whereof_clause\n",
"- legclf_illegality_clause\n",
"- legclf_indebtedness_clause\n",
"- legclf_guarantee_clause\n",
"- legclf_increased_costs_clause\n",
"- legclf_insurance_clause\n",
"- legclf_intellectual_property_clause\n",
"- legclf_interest_clause\n",
"- legclf_jurisdiction_clause\n",
"- legclf_letters_of_credit_clause\n",
"- legclf_liability_clause\n",
"...\n",
"```\n",
"All of these models are Binary Classifiers, which means they will return True or False, or better to say ,the name of the class (for example, `whereas`) if the class `whereas` is found, or `other` if it's not a `wheras` clause, but something else.\n",
"\n",
"CLARIFICATION: We did not want to return `True` or `False` because these models can all be stuck one after another, so in case a clause triggers some classes at the same time (clauses are very often not disjoint) we could be getting several `True`, which is less informative than retrieving directly the type of the classes detected `interest` and `increased_costs` for example.\n"
]
},
{
"cell_type": "markdown",
"metadata": {
"collapsed": false,
"id": "cXm2ilVc3pqw"
},
"source": [
"## Example of how splitting affects paragraph classification"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "iYgqcMd43pqy"
},
"outputs": [],
"source": [
"document_assembler = nlp.DocumentAssembler() \\\n",
" .setInputCol(\"text\") \\\n",
" .setOutputCol(\"document\")\n",
"\n",
"text_splitter = legal.TextSplitter() \\\n",
" .setInputCols([\"document\"]) \\\n",
" .setOutputCol(\"pages\")\\\n",
" .setCustomBounds([\"\\n+\\s*[0-9-ivx]+\\s*\\n+\"])\\\n",
" .setUseCustomBoundsOnly(True)\\\n",
" .setExplodeSentences(True)\n",
"\n",
"nlp_pipeline = nlp.Pipeline(stages=[\n",
" document_assembler,\n",
" text_splitter])"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "rWMysWTfKto7"
},
"outputs": [],
"source": [
"sdf = spark.createDataFrame([[ credit_agreement ]]).toDF(\"text\")\n",
"\n",
"fit = nlp_pipeline.fit(sdf)\n",
"\n",
"lp = nlp.LightPipeline(fit)\n",
"\n",
"res = lp.annotate(credit_agreement)\n",
"pages = res['pages']\n",
"pages = [p for p in pages if p.strip() != ''] # We remove empty pages"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "d8LpHAK0KrBC"
},
"outputs": [],
"source": [
"candidates = [[pages[0]], [pages[5]], [pages[8]], [pages[9]]]"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "K0DdUbIyLz8D",
"outputId": "bdd0019a-7c57-4020-f743-9c3b523322ca"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"sent_bert_base_cased download started this may take some time.\n",
"Approximate size to download 389.1 MB\n",
"[OK!]\n",
"legclf_whereas_clause download started this may take some time.\n",
"[OK!]\n"
]
}
],
"source": [
"document_assembler = nlp.DocumentAssembler() \\\n",
" .setInputCol(\"text\") \\\n",
" .setOutputCol(\"document\")\n",
"\n",
"embeddings = nlp.BertSentenceEmbeddings.pretrained(\"sent_bert_base_cased\", \"en\") \\\n",
" .setInputCols(\"document\") \\\n",
" .setOutputCol(\"sentence_embeddings\")\n",
"\n",
"doc_classifier = legal.ClassifierDLModel.pretrained('legclf_whereas_clause', \"en\", \"legal/models\")\\\n",
" .setInputCols([\"sentence_embeddings\"])\\\n",
" .setOutputCol(\"category\")\n",
"\n",
"nlp_pipeline = nlp.Pipeline(stages=[\n",
" document_assembler, \n",
" embeddings,\n",
" doc_classifier])"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "fo4_YSLeMEUp",
"outputId": "9f06e7ba-ee83-42f5-f6ae-0afb898b18c3"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+---------+\n",
"| result|\n",
"+---------+\n",
"| [other]|\n",
"| [other]|\n",
"|[whereas]|\n",
"| [other]|\n",
"+---------+\n",
"\n"
]
}
],
"source": [
"df = spark.createDataFrame(candidates).toDF(\"text\")\n",
"\n",
"model = nlp_pipeline.fit(df)\n",
"\n",
"result = model.transform(df)\n",
"result.select('category.result').show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "Rmh6ruAyNCYh"
},
"source": [
"we have some whereas information in `page[8]`!"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "9JXB_GdWMtJi",
"outputId": "03ab79e9-a008-4141-ed8a-c72be4ae5a17"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"CREDIT AGREEMENT\n",
"\n",
" THIS CREDIT AGREEMENT is dated as of April 29, 2010, and is made by and\n",
"among P.H. GLATFELTER COMPANY, a Pennsylvania corporation ( the \"COMPANY\") and\n",
"certain of its subsidiaries identified on the signature pages hereto (each a\n",
"\"BORROWER\" and collectively, the \"BORROWERS\"), each of the GUARANTORS (as\n",
"hereinafter defined), the LENDERS (as hereinafter defined), PNC BANK, NATIONAL\n",
"ASSOCIATION, in its capacity as agent for the Lenders under this Agreement\n",
"(hereinafter referred to in such capacity as the \"ADMINISTRATIVE AGENT\"), and,\n",
"for the limited purpose of public identification in trade tables, PNC CAPITAL\n",
"MARKETS LLC and CITIZENS BANK OF PENNSYLVANIA, as joint arrangers and joint\n",
"bookrunners, and CITIZENS BANK OF PENNSYLVANIA, as syndication agent.\n",
"\n",
" WITNESSETH:\n",
"\n",
" WHEREAS, the Borrowers have requested the Lenders to provide a revolving\n",
"credit facility to the Borrowers in an aggregate principal amount not to exceed\n",
"$225,000,000; and\n",
"\n",
" WHEREAS, proceeds of the revolving credit facility shall be used for (1)\n",
"refinancing existing Indebtedness, and (2) general corporate purposes; and\n",
"\n",
" WHEREAS, the Lenders are willing to provide such credit upon the terms and\n",
"conditions hereinafter set forth;\n",
"\n",
" NOW, THEREFORE, the parties hereto, in consideration of their mutual\n",
"covenants and agreements hereinafter set forth and intending to be legally bound\n",
"hereby, covenant and agree as follows:\n",
"\n",
" 1. CERTAIN DEFINITIONS\n",
"\n",
" 1.1 CERTAIN DEFINITIONS.\n",
"\n",
" In addition to words and terms defined elsewhere in this Agreement,\n",
"the following words and terms shall have the following meanings, respectively,\n",
"unless the context hereof clearly requires otherwise:\n",
"\n",
" 2006 SENIOR NOTES shall mean the Company's 7 ?% senior notes,\n",
"issued in 2006 and due May 1, 2016, in the aggregate principal amount of\n",
"$200,000,000, guarantied by certain of the Loan Parties.\n",
"\n",
" 2010 SENIOR NOTES shall mean the Company's 7 ?% senior notes,\n",
"issued in 2010 and due May 1, 2016, in the aggregate principal amount of\n",
"$100,000,000, guarantied by certain of the Loan Parties.\n",
"\n",
" ACCOUNTS RECEIVABLE FACILITY DOCUMENTS means all documentation\n",
"entered into by the Company and its Subsidiaries, including, without limitation,\n",
"the Receivables Entity, in connection with the sale or other transfer of\n",
"accounts receivable and other related assets pursuant to a Permitted Accounts\n",
"Receivable Program, as such documentation may be\n",
"\n",
"\n",
"\n",
"amended, restated, supplemented or otherwise modified from time to time in\n",
"accordance with the terms hereof and thereof.\n",
"\n",
" ADMINISTRATIVE AGENT shall have the meaning given to such term in\n",
"the introductory paragraph hereof.\n",
"\n",
" ADMINISTRATIVE AGENT'S FEE shall have the meaning assigned to\n",
"that term in Section 9.15.\n",
"\n",
" ADMINISTRATIVE AGENT'S LETTER shall have the meaning assigned to\n",
"that term in Section 9.15.\n",
"\n",
" AFFILIATE as to any Person shall mean any other Person (i) which,\n",
"directly or indirectly controls, is controlled by, or is under common control\n",
"with such Person. For purposes of this definition, \"control\" (including, with\n",
"correlative meanings, the term \"controlled by\" and \"under common control with\")\n",
"shall mean the power, directly or indirectly, either to (a) vote 10% or more of\n",
"the securities having ordinary voting power for the election of directors of\n",
"such Person or (b) direct or cause the direction of the management and policies\n",
"of such Person whether through the ownership of voting securities or by contract\n",
"or otherwise, including the power to elect a majority of the directors of a\n",
"corporation.\n",
"\n",
" AGREEMENT shall mean this Credit Agreement, as the same may be\n",
"extended, renewed, amended, supplemented or restated from time to time,\n",
"including all schedules and exhibits.\n",
"\n",
" ANTI-TERRORISM LAWS shall mean any Laws relating to terrorism or\n",
"money laundering, including Executive Order No. 13224, the USA Patriot Act, the\n",
"Laws comprising or implementing the Bank Secrecy Act, and the Laws administered\n",
"by the United States Treasury Department's Office of Foreign Asset Control (as\n",
"any of the foregoing Laws may from time to time be amended, renewed, extended,\n",
"or replaced).\n",
"\n",
" APPLICABLE COMMITMENT FEE RATE shall mean the percentage rate per\n",
"annum at the indicated level of Debt Rating in the pricing grid on SCHEDULE\n",
"1.1(A) next to the line titled \"Commitment Fee.\" The Applicable Commitment Fee\n",
"Rate shall be computed in accordance with the parameters set forth on SCHEDULE\n",
"1.1(A).\n",
"\n",
" APPLICABLE MARGIN shall mean the percentage spread to be added to\n",
"Euro-Rate under the Euro-Rate Option or to the Base Rate under the Base Rate\n",
"Option at the indicated level of Debt Rating in the pricing grid on SCHEDULE\n",
"1.1(A) next to the line titled \"Euro-Rate Spread\" or \"Base Rate Spread.\" The\n",
"Applicable Margin shall be computed in accordance with the parameters set forth\n",
"on SCHEDULE 1.1(A).\n",
"\n",
" ASSIGNMENT AND ASSUMPTION AGREEMENT shall mean an Assignment and\n",
"Assumption Agreement by and among a Purchasing Lender, a Transferor Lender and\n",
"the Administrative Agent, as Administrative Agent and on behalf of the remaining\n",
"Lenders, substantially in the form of EXHIBIT 1.1(A).\n"
]
}
],
"source": [
"print(pages[8])"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "JHZc5uvhNGJr"
},
"source": [
"But what if the splitting would have been different?"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "DVMAgadm3pqy"
},
"outputs": [],
"source": [
"text = \"\"\"\n",
"-vii-\n",
"\n",
"\n",
"\n",
" LIST OF SCHEDULES AND EXHIBITS\n",
"\n",
"SCHEDULES\n",
"SCHEDULE 1.1(A) - PRICING GRID\n",
"SCHEDULE 1.1(B) - COMMITMENTS OF BANKS AND ADDRESSES FOR NOTICES\n",
"SCHEDULE 1.1(E) - EXISTING LETTERS OF CREDIT\n",
"SCHEDULE 1.1(M) - MATERIAL SUBSIDIARIES\n",
"SCHEDULE 1.1(P) - PERMITTED LIENS\n",
"SCHEDULE 5.1.1 - DOMESTIC QUALIFICATIONS TO DO BUSINESS\n",
"SCHEDULE 5.1.2 - SUBSIDIARIES\n",
"SCHEDULE 5.1.6 - LITIGATION\n",
"SCHEDULE 5.1.12 - CONSENTS AND APPROVALS\n",
"SCHEDULE 5.1.14 - PATENTS, TRADEMARKS, COPYRIGHTS, LICENSES, ETC.\n",
"SCHEDULE 7.2.1 - PERMITTED INDEBTEDNESS\n",
"SCHEDULE 7.2.4 - EXISTING INVESTMENTS\n",
"\n",
"EXHIBITS\n",
"EXHIBIT 1.1(A) - ASSIGNMENT AND ASSUMPTION AGREEMENT\n",
"EXHIBIT 1.1(B) - BORROWER JOINDER\n",
"EXHIBIT 1.1(G)(1) - GUARANTOR JOINDER\n",
"EXHIBIT 1.1(G)(2) - GUARANTY AGREEMENT\n",
"EXHIBIT 1.1(R) - REVOLVING CREDIT NOTE\n",
"EXHIBIT 1.1(S) - SWING LOAN NOTE\n",
"EXHIBIT 2.4 - LOAN REQUEST\n",
"EXHIBIT 6.1.4 - OPINION OF COUNSEL\n",
"EXHIBIT 7.2.6 - ACQUISITION COMPLIANCE CERTIFICATE\n",
"EXHIBIT 7.3.3 - QUARTERLY COMPLIANCE CERTIFICATE\n",
"\n",
"\n",
" -viii-\n",
"\n",
"\n",
"\n",
" CREDIT AGREEMENT\n",
"\n",
" THIS CREDIT AGREEMENT is dated as of April 29, 2010, and is made by and\n",
"among P.H. GLATFELTER COMPANY, a Pennsylvania corporation ( the \"COMPANY\") and\n",
"certain of its subsidiaries identified on the signature pages hereto (each a\n",
"\"BORROWER\" and collectively, the \"BORROWERS\"), each of the GUARANTORS (as\n",
"hereinafter defined), the LENDERS (as hereinafter defined), PNC BANK, NATIONAL\n",
"ASSOCIATION, in its capacity as agent for the Lenders under this Agreement\n",
"(hereinafter referred to in such capacity as the \"ADMINISTRATIVE AGENT\"), and,\n",
"for the limited purpose of public identification in trade tables, PNC CAPITAL\n",
"MARKETS LLC and CITIZENS BANK OF PENNSYLVANIA, as joint arrangers and joint\n",
"bookrunners, and CITIZENS BANK OF PENNSYLVANIA, as syndication agent.\n",
"\n",
" WITNESSETH:\n",
"\n",
" WHEREAS, the Borrowers have requested the Lenders to provide a revolving\n",
"credit facility to the Borrowers in an aggregate principal amount not to exceed\n",
"$225,000,000; and\n",
"\n",
" WHEREAS, proceeds of the revolving credit facility shall be used for (1)\n",
"refinancing existing Indebtedness, and (2) general corporate purposes; and\n",
"\n",
" WHEREAS, the Lenders are willing to provide such credit upon the terms and\n",
"conditions hereinafter set forth;\n",
"\n",
" NOW, THEREFORE, the parties hereto, in consideration of their mutual\n",
"covenants and agreements hereinafter set forth and intending to be legally bound\n",
"hereby, covenant and agree as follows:\"\"\""
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "B4W3DPB89qk5",
"outputId": "b1c08ec1-b6f8-4d53-e008-9ab33f0a1537"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+-------+\n",
"| result|\n",
"+-------+\n",
"|[other]|\n",
"+-------+\n",
"\n"
]
}
],
"source": [
"df = spark.createDataFrame([[text]]).toDF(\"text\")\n",
"\n",
"model = nlp_pipeline.fit(df)\n",
"\n",
"result = model.transform(df)\n",
"result.select('category.result').show()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "YTfdRqXGNfLD"
},
"source": [
"#๐ Conclusions\n",
"\n",
"Splitting affects directly the quality of the predictions. This is because of two factors:\n",
"- 1) Predicting much text at the same time usually adds too much information, and specific sections may be deluted in the overall context;\n",
"- 2) Also token size restrictions may have happened!"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "nn7LM80Vla1A"
},
"outputs": [],
"source": []
}
],
"metadata": {
"colab": {
"provenance": [],
"toc_visible": true
},
"gpuClass": "standard",
"kernelspec": {
"display_name": "tf-gpu",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.7 (default, Sep 16 2021, 16:59:28) [MSC v.1916 64 bit (AMD64)]"
},
"vscode": {
"interpreter": {
"hash": "3f47d918ae832c68584484921185f5c85a1760864bf927a683dc6fb56366cc77"
}
}
},
"nbformat": 4,
"nbformat_minor": 0
}