--- name: paper-graph description: "Map the genealogical lineage and historical progression of a research field. Visualize how earlier technical challenges led to later approaches and improvements, producing a Markdown report with embedded Mermaid diagrams. Trigger when the user asks for a topic's developmental trajectory, a model's family tree, significant predecessors or follow-ups to a seed paper, or how a research line matured over time. Do not trigger for inventories of datasets, benchmarks, libraries, or other artifacts; finding one latest paper; simple keyword search; one-paper summaries; or head-to-head comparisons. Use this skill for chronological synthesis across multiple works, not for bibliography cataloging or one-off retrieval." allowed-tools: "write_file edit_file read_file execute" metadata: author: EvoScientist version: '0.1.3' tags: [research, literature-review, graph, mermaid] --- # Paper Graph Build a Markdown report with embedded Mermaid diagrams showing how research on a user-specified topic (or paper) evolved — clustered into challenges → solutions and traced as per-solution evolution paths. The skill has no outbound LLM dependency. The host agent provides all LLM calls; the skill provides deterministic data fetchers (S2 / DeepXiv), prompt templates, markdown parsers, and Mermaid renderers. Run the runbook below step-by-step. **Execution requirement.** When the caller already provides `parsed_query.json`, `seed.json` and `papers.json` (wherever they are, for example in an `input/` directory), copy them into the workdir under those names, treat steps 1–5 as complete and start at step 6. Still run every deterministic CLI step from classify through assemble; do not replace parsing, edge audit, rendering, or assembly with hand-authored Mermaid. Before finishing, verify that every parsed solution has a detail render and an audit verdict file, even when that file is an empty JSON list. Treat `assemble_report` as the only final-report writer: do not edit or append hand-authored edges afterward, even when a caller asks to display uncertain relationships. Preserve uncertainty in verdict JSON. ## When to Use This Skill Trigger when the user asks something like: - "Show me the history of " / "How did evolve?" - "Where does stem from?" / "What did build on?" - "What are significant improvements / follow-ups to ?" - "Trace the lineage of ideas in " / "Give me a literature taxonomy of " - "Citation tree of " / "Idea trace of " Skip when: - The user just wants a one-paper summary or single search hit (no relational/evolutionary aspect). - The request is for non-academic citation work. - The user explicitly wants a plain bibliography rather than a graph. --- ## Inputs and Output **Inputs:** - A **research query**: a topic, a seed paper title/citation, or a hybrid. Free-form text. - **Output path** (required): path for the final Markdown report. If not given, ask before running. - *(Optional)* number of papers to fetch (`--n` flag on `fetch_papers`). Default **10**. - *(Optional)* Mermaid theme `light` or `dark` (`--theme` on render steps, or `MERMAID_THEME` env). Default **light**. **Output:** a single Markdown file at the user-specified path with these sections: 1. **Research goal** (extracted from the query) 2. **High-level taxonomy** — one Mermaid graph: root → challenges → solutions → paper references 3. **Per-solution evolution paths** — one Mermaid graph per solution, showing paper-to-paper "evolution from" edges, evolution points, open challenges 4. **Paper appendix** — the numbered list of papers with title / year / authors / abstract / conclusion excerpt Mermaid is just text inside ```` ```mermaid ```` fences — the file renders directly in GitHub, Obsidian, VS Code with the Mermaid extension, etc. --- ## Setup **Required env (the skill fails verbosely if missing):** - `S2_API_KEY` — Semantic Scholar API key. **Optional env:** - `DEEPXIV_API_TOKEN` (or `DEEPXIV_TOKEN`) — DeepXiv arXiv search fallback. Install with `pip install deepxiv-sdk`; auto-provision with `deepxiv token`. Without it, S2 must fill the cite-number budget on its own. - `MERMAID_THEME` — `light` (default) or `dark`. Overridden by `--theme` on each render call. **LLM:** the host agent uses its own model and API key. The skill emits prompt templates and parses responses; it does not authenticate or call any LLM provider. **Working directory:** create one dir per run, anchored **relative to your current working directory** (e.g. `./.work/`). Avoid absolute system paths like `/tmp/...` — some harnesses sandbox the shell and the file-read tools to different filesystem roots, so an absolute path can appear writable to one and missing to the other. A cwd-relative path works the same everywhere. Run `pwd` once at the start if unsure. Suggested layout (assuming final report goes to ``): ``` .work/ ├── query.txt user query (verbatim) ├── seed.json resolve_seed_papers ├── seed_block.txt format_seed_block ├── parsed_query.json LLM: parse_query output ├── goal_block.txt build_goal_block (reused in steps 8, 10, 11) ├── papers.json fetch_papers → prefetch_sections → classify-merged ├── papers_input.txt format_papers (full set) ├── classify_raw.json LLM: classify output (consumed by merge_classifications) ├── core_filter.json compute_core_filter (+ core_filter.json.allowed.txt) ├── papers_input_core.txt format_papers (CORE-only; + papers_input_core.txt.allowed.txt) ├── outline_raw.md LLM: outline output ├── outline.json parse_outline summary ├── outline_mermaid.json render_outline_mermaid ├── solutions/.json per-solution context (one file per solution) ├── parsed/.json parse_detail output (used by step 11 audit) ├── details/ │ ├── _input.txt format_papers (optional: same content as papers_input_core.txt; + .allowed.txt sibling) │ ├── _raw.md LLM: detail output │ └── .json render_detail_mermaid (consumed by assemble) ├── verdicts/.json [{source_n, target_n, verdict, source_quote, target_quote, reason}] from audit ([] when no edges) └── .log.jsonl files one next to each subcommand output, default-on ``` Filenames are agent-chosen — these are recommendations to match what the runbook below references. `` is the solution key string `.` (e.g. `1.1`). Every `format_papers` call writes a sibling `.allowed.txt` containing the `(N), (N), ...` form ready to drop into a `{allowed_numbers}` placeholder. --- ## Runbook Each step is either a **CLI** call (`python scripts/cli.py …`) or an **LLM** call (the host agent reads a template from `references/`, substitutes the placeholders, and calls its model). All script and reference paths are relative to this skill's directory. CLI dependencies: `pip install deepxiv-sdk httpx python-dotenv` (also listed in `requirements.txt` at the skill root) — install into the environment the user is working in. Run sequentially; the detail step (step 10) and the audit step (step 11) can fan out per-solution / per-edge if the host supports concurrent tool calls. **Placeholder syntax in `references/*.md`.** Single-brace `{name}` is a template slot the host must substitute. Double-brace `{{...}}` is an escaped literal brace — it appears in the prompt body when the example JSON the LLM is asked to emit contains braces. Substitute only single-brace slots; leave `{{` and `}}` alone (they're for the LLM to read as `{` and `}` in its output). ### Step 1 — Save the user query Write the user's verbatim query to `/query.txt`. Do not paraphrase. Multi-line queries are fine. ### Step 2 — `resolve_seed_papers` (CLI, deterministic) ```bash python scripts/cli.py resolve_seed_papers \ --query-file /query.txt \ --out /seed.json ``` Outputs a JSON array of S2-shape paper records for any arxiv IDs detected in the query. Empty array when none are present or all lookups fail. ### Step 3 — `format_seed_block` (CLI, deterministic) ```bash python scripts/cli.py format_seed_block \ --seed /seed.json \ --out /seed_block.txt ``` Renders the seed papers into the `{seed_block}` prompt fragment used in step 4. Empty input → empty output (the placeholder collapses cleanly). ### Step 4 — `parse_query` (LLM) Read `references/parse_query.md`. Substitute `{seed_block}` with the contents of `/seed_block.txt` and `{query}` with the contents of `/query.txt`. Call the LLM (low temperature, ~0.1). Parse the response as JSON with this exact shape: ```json {"goal": "", "searches": ["", "", "..."], "definitions": {"": "", "...": "..."}} ``` Per the prompt's own instructions, `searches` should contain 2–4 phrases each of 2–5 keywords (these are two different counts — phrases vs. keywords-per-phrase). Strip code fences if the model added them. Validate that `goal` is non-empty and `searches` is a non-empty list of strings. If the response is malformed, re-prompt the LLM once; on second failure, abort with a clear error message. Save the validated JSON to `/parsed_query.json`. ### Step 5 — `fetch_papers` (CLI, deterministic) ```bash python scripts/cli.py fetch_papers \ --parsed-query /parsed_query.json \ --seed /seed.json \ --n 10 \ --out /papers.json ``` Uses S2 multi-search (one S2 query per `searches[]` entry) with DeepXiv fallback to top up to `--n` papers. Output is a JSON array of S2-shape paper dicts. If S2 returns nothing and DeepXiv is unavailable, exits non-zero — re-prompt step 4 with sharper search phrases. ### Step 6 — `classify` (LLM) First build the full `{papers_input}` block: ```bash python scripts/cli.py format_papers \ --papers /papers.json \ --out /papers_input.txt ``` Read `references/classify.md`. Substitute `{goal}` with the `goal_sentence` (the single-sentence string at `parsed_query.json["goal"]` — bare, no definitions block here) and `{papers_input}` with the text file above. Call the LLM (low temperature, no reasoning needed — it's a discrete cataloging decision). Strip any leading/trailing code fences if the model added them. Save the raw response verbatim to `/classify_raw.json`. Expected shape: ```json {"classifications": [ {"n": 1, "label": "CORE", "reason": "..."}, {"n": 2, "label": "ADJACENT", "reason": "..."}, {"n": 3, "label": "REJECT", "reason": "..."}, ... ]} ``` Then merge into papers.json via the CLI (validates shape + applies failure-soft fallback to every-CORE if validation fails): ```bash python scripts/cli.py merge_classifications \ --classifications /classify_raw.json \ --papers /papers.json \ --out /papers.json ``` `merge_classifications` always exits 0; on validation failure it applies an all-CORE safety-net and prints a `… (FALLBACK: )` suffix on the stdout success line. When you see that suffix, re-prompt the LLM once; if the second attempt also falls back, accept the all-CORE result and proceed — every paper just feeds the outline as CORE. On a clean run the success line shows the per-label counts and no FALLBACK suffix. Downstream subcommands (`parse_outline`, the renderers, `assemble_report`) read these labels via `_label_of`. ### Step 7 — `prefetch_sections` (CLI, deterministic, best-effort) ```bash python scripts/cli.py prefetch_sections \ --in /papers.json \ --out /papers.json ``` Mutates each paper dict in place by setting `_conclusion_section`. REJECT-labeled papers are skipped to save quota. Failures are silent; a paper without an arxiv ID or without a fetchable section just gets `_conclusion_section: null`. After this step, any subsequent `format_papers` call automatically embeds each paper's `_conclusion_section` into the formatted block (under a `Discussion/Conclusion excerpt:` header) — that's how the outline and detail prompts get the OC-source signal the prompt templates reference. No extra step required. ### Step 8 — `outline` (LLM) Materialize the two prompt fragments that recur from here on — `goal_block` (the `{goal}` substitution) and `core_filter` (the CORE-only filter + its `{allowed_numbers}` sidecar) — as files on disk. Steps 10 and 11 read these files back, so the agent never has to carry them as conversation state. ```bash python scripts/cli.py build_goal_block \ --parsed-query /parsed_query.json \ --out /goal_block.txt python scripts/cli.py compute_core_filter \ --papers /papers.json \ --out /core_filter.json ``` `compute_core_filter` writes the index JSON to `--out` and the matching `(N), (N), ...` `{allowed_numbers}` form to a sibling `.allowed.txt`. A paper without a classification counts as CORE, as everywhere else in this skill. On a no-CORE classifier outcome it falls back to every paper and prints `(FALLBACK: …)` — the run continues. Build the CORE-only `{papers_input}` (also emits a sibling `.allowed.txt`, redundant here but consistent with Step 10): ```bash python scripts/cli.py format_papers \ --papers /papers.json \ --filter /core_filter.json \ --out /papers_input_core.txt ``` Read `references/outline.md`. Substitute: - `{goal}` — contents of `/goal_block.txt`. - `{papers_input}` — contents of `/papers_input_core.txt`. - `{allowed_numbers}` — contents of `/core_filter.json.allowed.txt`. Call the LLM (low temperature, ~0.2; allow ~8000 max tokens). Strip any leading/trailing code fences from the response — the prompt instructs the model to emit raw Markdown but a fence sometimes slips through. Save the cleaned Markdown to `/outline_raw.md`. ### Step 9 — `parse_outline` (CLI, deterministic) ```bash python scripts/cli.py parse_outline \ --raw /outline_raw.md \ --papers /papers.json \ --out /outline.json \ --solutions-dir /solutions ``` Writes the outline summary plus one `solutions/.json` context file per solution. Schema of each context file (consumed in steps 10 and 12): ```json { "challenge_idx": 1, "challenge_name": "Quality of random-projection targets", "solution_key": [1, 1], "solution_key_str": "1.1", "solution_name": "Optimization of the BEST-RQ pre-training objective", "paper_nums": [1, 3], "allowed": [1, 2, 3, 4] } ``` `paper_nums` is the valid, de-duplicated primary taxonomy membership; when the outline repeats a paper, its first placement wins. `allowed` contains all CORE papers so detail generation can recover a canonical predecessor or successor without duplicating its primary taxonomy placement. `format_papers --filter ` and `parse_detail --context ` both read `allowed` automatically. Use `paper_nums` only for the `{primary_numbers}` prompt field. A solution header that the outline restates reopens the same solution. A solution left without any valid paper (all its numbers were hallucinated or already placed elsewhere) is pruned: it gets no context file and no node in the taxonomy, and the success line on stdout names it. So every context file has a non-empty `paper_nums`. Exits with code 4 and a stderr diagnostic if the outline contained no parseable `## Challenge N:` headers, or if no solution is left with a valid paper. Re-prompt step 8 once; on second failure, lower `--n` in step 5 or sharpen the query. ### Step 10 — `detail` (LLM, per solution) > **CRITICAL — read "Fan-out task brief" below BEFORE delegating this step to subagents.** A subagent prompt that points at SKILL.md or asks to "run paper-graph for solution X" will restart the whole workflow from Step 1 in a separate workdir, and its output will be unusable by the parent run. Read `references/detail.md` **once** at the start of this step; substitute per-solution in the orchestrator. The subagents you fan out to never read templates themselves. For each `/solutions/.json` produced in step 9: (a) The per-solution `{papers_input}` is the CORE pool: every solution context's `allowed` is the full CORE set, so the block is the same for every solution and identical to `/papers_input_core.txt` from Step 8 (with its `.allowed.txt` sibling). Reuse those two files. Running `format_papers --filter /solutions/.json --out /details/_input.txt` per solution still works and writes the same content; it is only needed if Step 8's files are gone. (b) Substitute into `references/detail.md`: - `{goal}` — contents of `/goal_block.txt` (the file built in Step 8). - `{challenge_name}` — from the solution context (`challenge_name`). - `{solution_name}` — from the solution context (`solution_name`). - `{primary_numbers}` — comma-separated `(N)` values from the solution context's `paper_nums`. - `{papers_input}` — contents of `/papers_input_core.txt` (or the per-solution copy). - `{allowed_numbers}` — contents of `/papers_input_core.txt.allowed.txt`. Call the LLM (temperature ~0.2; allow ~12000 max tokens to fit scratchpad + tree). Save the raw response to `/details/_raw.md`. (c) Parse it (output goes to a sibling `parsed/` dir, not `details/`, so step 13's `assemble_report` doesn't pick up parse outputs as render outputs): ```bash python scripts/cli.py parse_detail \ --raw /details/_raw.md \ --context /solutions/.json \ --out /parsed/.json ``` The parsed JSON's `edges` list is the input to Step 11. If the host supports concurrent tool calls, fan all per-solution LLM calls + their parse_detail follow-ups out in parallel. **Fan-out task brief (when delegating step 10b to a subagent per solution).** The subagent's prompt must be self-contained: do **not** point the subagent at SKILL.md, do **not** instruct it to "run paper-graph for solution X," and do **not** give it any CLI invocation to run. The orchestrator does the substitution itself and hands the subagent only: - The fully-substituted prompt string (already with `{goal}`, `{challenge_name}`, `{solution_name}`, `{primary_numbers}`, `{papers_input}`, `{allowed_numbers}` filled in). - The expected response shape: raw Markdown evolution tree per `references/detail.md`'s output spec. - An explicit instruction: *"Call your LLM with the prompt below and return only the raw Markdown response. Do not read any other file, do not run any shell command, do not invoke any other skill."* Do **not** point the subagent at SKILL.md, do **not** instruct it to "run paper-graph for solution X", and do **not** give it any CLI invocation to run. The subagent returns the Markdown text; the orchestrator writes it to `/details/_raw.md` and runs `parse_detail` itself. **A subagent that re-reads SKILL.md will restart the whole workflow from step 1** — the fix is to keep the subagent prompt bounded as above. ### Step 11 — `audit_edge` (LLM, per edge) > **CRITICAL — read "Fan-out task brief" below BEFORE delegating this step to subagents.** Same orchestration failure mode as Step 10: a subagent pointed at SKILL.md restarts the whole workflow. Read `references/audit_edge.md` **once** at the start of this step; substitute per-edge in the orchestrator. The subagents you fan out to never read templates themselves. For each `/parsed/.json`'s `edges` list, audit each edge against the source / target abstracts and conclusion excerpts. For every `{source_n, target_n, gap}` edge in the solution: - Look up source paper = `papers[source_n - 1]` and target = `papers[target_n - 1]` from `/papers.json`. - Substitute the placeholders in `references/audit_edge.md`: `{m_n}`, `{m_title}`, `{m_year}`, `{m_abstract}` (truncated to 1500 chars), `{m_excerpt}` (the `_conclusion_section` or `(no excerpt)`, truncated to 1500 chars), `{n_n}`, `{n_title}`, `{n_year}`, `{n_abstract}`, `{n_excerpt}`, `{gap_text}`. - Call the LLM (low temperature ~0.1, reasoning off, ~1000 max tokens — enough for two quotes of up to 300 characters and the reason). Parse the response: ```json {"verdict": "SUPPORTED_BY_ABSTRACT" | "SUPPORTED_BY_SECTION" | "INFERRED" | "REJECT", "source_quote": "", "target_quote": "", "reason": ""} ``` On parse failure, default the verdict to `REJECT`. Only `SUPPORTED_BY_ABSTRACT` and `SUPPORTED_BY_SECTION` become directed evolution edges. `INFERRED` records a possible relationship for the audit trail but is not rendered as a directed lineage claim. **Fan-out task brief (when delegating per edge or per solution to subagents).** Same discipline as step 10: do **not** point the subagent at SKILL.md, do **not** instruct it to "run paper-graph audit," and do **not** give it any CLI invocation. The orchestrator does the substitution itself and hands the subagent only: - The fully-substituted prompt string (already with `{m_n}`, `{m_title}`, `{m_year}`, `{m_abstract}`, `{m_excerpt}`, `{n_n}`, `{n_title}`, `{n_year}`, `{n_abstract}`, `{n_excerpt}`, `{gap_text}` filled in). - The expected response shape: a JSON object with `verdict`, `source_quote`, `target_quote`, and `reason`. - An explicit instruction: *"Call your LLM with the prompt below and return only the JSON verdict object. Do not read any other file, do not run any shell command, do not invoke any other skill."* The subagent returns the verdict JSON; the orchestrator aggregates per-solution lists into `/verdicts/.json`. A subagent given a prompt that references SKILL.md will restart the workflow from step 1 — keep the brief bounded. Collect all per-solution verdicts into `/verdicts/.json` as a flat list: ```json [{"source_n": 1, "target_n": 3, "verdict": "SUPPORTED_BY_ABSTRACT", "source_quote": "", "target_quote": "", "reason": "..."}, ...] ``` Write one record per audited edge, and write the file even when the solution has no edges (`[]`): step 12 requires it. Copy each quote exactly as the audit returned it; do not repair or shorten quotes by hand. The renderer in step 12 re-checks every record against `papers.json` and draws an edge only when all of the following hold; anything else is not rendered as directed lineage: - the verdict is `SUPPORTED_BY_ABSTRACT` or `SUPPORTED_BY_SECTION`; - each quote is at least 20 characters, is not `NONE`, and occurs inside that paper's title, abstract or excerpt — inside one of them, not across two (line breaks, repeated spaces and typographic quotes or dashes are normalized before matching; wording and case are not); - the source is not newer than the target (when a year is missing the check is skipped and noted); - source and target are different papers inside `papers.json`; - if several records name the same edge, every one of them passes; - the edge is not part of a cycle of supported edges (possible when years are equal or missing). A malformed record (not an object, or without integer `source_n` / `target_n`) is ignored and reported; it does not stop the render. ### Step 12 — `render_outline_mermaid` + `render_detail_mermaid` (CLI, deterministic) ```bash python scripts/cli.py render_outline_mermaid \ --raw /outline_raw.md \ --papers /papers.json \ --out /outline_mermaid.json \ [--theme dark] ``` For each solution: ```bash python scripts/cli.py render_detail_mermaid \ --raw /details/_raw.md \ --context /solutions/.json \ --papers /papers.json \ --verdicts /verdicts/.json \ --out /details/.json \ [--theme dark] ``` `--verdicts` is required: a render without the audit would draw every claimed edge. The success line reports how many claimed edges were rendered, followed by one line per edge that was not (`not rendered (1)->(3): source_quote not found …`), per ignored verdict record, and per verdict that matches no edge of this detail output (a sign that the verdict file is stale or belongs to another solution). The same information is stored in the output JSON (`edges_rendered`, `edges_not_rendered`, `verdicts_unmatched`, `audit_downgrades`, `audit_notes`) next to `"audited": true`. An edge that is not rendered stays out of the graph; do not edit the verdict file to force it in. ### Step 13 — `assemble_report` (CLI, deterministic) ```bash python scripts/cli.py assemble_report \ --parsed-query /parsed_query.json \ --outline /outline_mermaid.json \ --details-dir /details \ --papers /papers.json \ --out ``` Walks `details/` for every render JSON, sorts by `(challenge_idx, s_major, s_minor)`, writes the final Markdown report at the user-supplied output path. A render JSON without `"audited": true` (left over from a run without `--verdicts` or from an older version) stops the command with exit code 2 before anything is written; re-run step 12 for the files it names. Only `*.json` files containing a `mermaid` field are consumed — `*_raw.md`, `*_input.txt`, and any non-render JSON sitting alongside are skipped (and counted on stdout if any). This is why parse_detail outputs go to a sibling `parsed/` dir per the workdir layout, not into `details/`. --- ## Verification After step 13 completes, read the first ~40 lines of the report to confirm: - The taxonomy has at least 2 challenges and each has at least 1 solution. - Each Mermaid block opens with ```` ```mermaid ```` and closes with ```` ``` ````. - The paper appendix exists at the bottom of the file. If any of those fail, the most likely cause is the outline LLM (step 8) returning malformed Markdown. Re-run step 8; if it fails twice, lower `--n` on step 5 or sharpen the query. --- ## Design notes (for editors of this skill, not the runtime agent) - **No outbound LLM dependency**: the skill exposes data fetchers, prompt templates (`references/*.md`), parsers, and renderers. The host agent is the LLM provider. This is why there's no `OPENROUTER_API_KEY` requirement and no `llm.py`. - **The audit gate is code, not prose**: `scripts/audit.py` re-checks every verdict record (label, quotes found in the paper's own text, chronology, self-edges, duplicates, cycles). `render_detail_mermaid` cannot run without `--verdicts`, stamps its output `"audited": true`, and `assemble_report` refuses a render without the stamp. `mermaid.py` takes its set of edge-drawing labels from `audit.SUPPORTED_VERDICTS`. - **Single source of truth for the detail parser**: `mermaid._parse_detail_markdown` is called by both `detail_to_mermaid` (rendering) and the `parse_detail` CLI subcommand. Any change to scratchpad stripping, paper/EP/OC extraction, or hallucination dropping propagates to both. - **`references/seed_paper_block.md` is an internal template fragment** consumed by `format_seed_block`; the runtime agent never substitutes its placeholders directly. The other five `references/*.md` files are the agent-facing templates the runbook references. - **Themed Mermaid**: `mermaid.py` defines `LIGHT_THEME` and `DARK_THEME`. The renderer subcommands resolve the theme by name (CLI arg) → `MERMAID_THEME` env → `"light"`. Each render emits a self-contained Mermaid graph (init directive + classDefs + linkStyle). - **JSONL logging is default-on**: every subcommand writes `.log.jsonl` next to its output unless `--log none` is passed. These logs are for the human developer iterating on the skill — the runtime agent should not read them back. - **`papers.json` is checked once per subcommand**: every step that reads it exits with code 2 and the offending entry numbers when the file is not an array of paper objects, instead of failing later on a missing field. - **Failure mode preference**: loud over silent. Missing keys, malformed LLM output, zero papers from search — all abort with a printed reason rather than producing a degraded artifact. - **English-only**: the upstream `paper-graph` prompts emitted bilingual labels; this skill strips Chinese and keeps English only.