{ "cells": [ { "cell_type": "markdown", "metadata": { "nbsphinx": "hidden" }, "source": [ "This notebook is part of the `nbsphinx` documentation: https://nbsphinx.readthedocs.io/." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Usage" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Project Setup\n", "\n", "In the directory with your notebook files, run this command (assuming you have [Sphinx](https://www.sphinx-doc.org/) and `nbsphinx` installed already):\n", "\n", " python3 -m sphinx.cmd.quickstart\n", "\n", "Answer the questions that appear on the screen. In case of doubt, just press the `` key repeatedly to take the default values.\n", "\n", "After that, there will be a few brand-new files in the current directory.\n", "You'll have to make a few changes to the file named `conf.py`.\n", "You should make sure that the `extensions` setting\n", "at least contains `'nbsphinx'`\n", "(but you might want to add other useful extensions as well):\n", "\n", "```python\n", "extensions = [\n", " 'nbsphinx',\n", "]\n", "```\n", "\n", "For an example, see this project's [conf.py](conf.py) file.\n", "\n", "Once your `conf.py` is in place,\n", "edit the file named `index.rst` and add the file names of your notebooks\n", "(without the `.ipynb` extension)\n", "to the\n", "[toctree](https://www.sphinx-doc.org/en/master/usage/restructuredtext/directives.html#directive-toctree)\n", "directive.\n", "For an example, see this project's `doc/index.rst` file.\n", "\n", "Alternatively, you can delete the file `index.rst`\n", "and replace it with your own notebook called `index.ipynb`\n", "which will serve as main page.\n", "In this case you can create the main [toctree](subdir/toctree.ipynb)\n", "in `index.ipynb`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Running Sphinx\n", "\n", "To create the HTML pages, use this command:\n", "\n", " python3 -m sphinx \n", "\n", "If you have many notebooks, you can do a parallel build by using the `-j` option:\n", "\n", " python3 -m sphinx -j\n", "\n", "For example, if your source files are in the current directory and you have 4 CPU cores, you can run this:\n", "\n", " python3 -m sphinx . _build -j4\n", "\n", "Afterwards, you can find the main HTML file in `_build/index.html`.\n", "\n", "Subsequent builds will be faster, because only those source files which have changed will be re-built.\n", "To force re-building all source files, use the `-E` option.\n", "\n", "
\n", "\n", "Note\n", "\n", "By default, notebooks will be executed during the Sphinx build process only if they do not have any output cells stored.\n", "See [Controlling Notebook Execution](executing-notebooks.ipynb).\n", "\n", "
\n", "\n", "To create LaTeX output, use:\n", "\n", " python3 -m sphinx -b latex\n", "\n", "If you don't know how to create a PDF file from the LaTeX output, you should have a look at [Latexmk](http://personal.psu.edu/jcc8//software/latexmk-jcc/) (see also [this tutorial](https://mg.readthedocs.io/latexmk.html)).\n", "\n", "Sphinx can automatically check if the links you are using are still valid.\n", "Just invoke it like this:\n", "\n", " python3 -m sphinx -b linkcheck" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Watching for Changes with `sphinx-autobuild`\n", "\n", "If you think it's tedious to run the Sphinx build command again and again while you make changes to your notebooks, you'll be happy to hear that there is a way to avoid that: [sphinx-autobuild](https://pypi.org/project/sphinx-autobuild)!\n", "\n", "It can be installed with\n", "\n", " python3 -m pip install sphinx-autobuild\n", "\n", "You can start auto-building your files with\n", "\n", " python3 -m sphinx_autobuild \n", "\n", "This will start a local webserver which will serve the generated HTML pages at http://localhost:8000/.\n", "Whenever you save changes in one of your notebooks, the appropriate HTML page(s) will be re-built and when finished, your browser view will be refreshed automagically.\n", "Neat!\n", "\n", "You can also abuse this to auto-build the LaTeX output:\n", "\n", " python3 -m sphinx_autobuild -b latex\n", "\n", "However, to auto-build the final PDF file as well, you'll need an additional tool.\n", "Again, you can use `latexmk` for this (see [above](#Running-Sphinx)).\n", "Change to the build directory and run\n", "\n", " latexmk -pdf -pvc\n", "\n", "If your PDF viewer isn't opened because of LaTeX build errors, you can use the command line flag `-f` to *force* creating a PDF file." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Automatic Creation of HTML and PDF output on readthedocs.org\n", "\n", "There are two different methods, both of which are described below.\n", "\n", "In both cases, you'll first have to create an account on https://readthedocs.org/\n", "and connect your GitLab/Github/Bitbucket/... account.\n", "Instead of connecting, you can also manually add\n", "any publicly available Git/Subversion/Mercurial/Bazaar/... repository.\n", "\n", "After doing the steps described below,\n", "you only have to \"push\" to your repository,\n", "and the HTML pages and the PDF file of your stuff\n", "are automagically created on readthedocs.org.\n", "Awesome!\n", "\n", "You can even have different versions of your stuff,\n", "just use Git tags and branches and select in the\n", "[readthedocs.org settings](https://readthedocs.org/dashboard/)\n", "which of those should be created.\n", "\n", "
\n", "\n", "Note\n", "\n", "If you want to execute notebooks\n", "(see [Controlling Notebook Execution](executing-notebooks.ipynb)),\n", "you'll need to install the appropriate Jupyter kernel.\n", "In the examples below,\n", "the IPython kernel is installed from the packet `ipykernel`.\n", "\n", "
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Using `requirements.txt`\n", "\n", "1. Create a file named `.readthedocs.yml`\n", " in the main directory of your repository\n", " with the following contents:\n", "\n", " ```yaml\n", " version: 2\n", " build:\n", " os: ubuntu-22.04\n", " tools:\n", " python: \"3\"\n", " python:\n", " install:\n", " - requirements: doc/requirements.txt\n", " ```\n", "\n", " For further options see https://docs.readthedocs.io/en/latest/config-file/.\n", "\n", "1. Create a file named `doc/requirements.txt`\n", " (or whatever you chose in the previous step)\n", " containing the required `pip` packages:\n", "\n", " ```\n", " ipykernel\n", " nbsphinx\n", " ```\n", "\n", " You can also install directly from Github et al., using a specific branch/tag/commit, e.g.\n", "\n", " ```\n", " git+https://github.com/spatialaudio/nbsphinx.git@master\n", " ```" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Using `conda`\n", "\n", "1. Create a file named `.readthedocs.yml`\n", " in the main directory of your repository\n", " with the following contents:\n", "\n", " ```yaml\n", " version: 2\n", " formats: all\n", " conda:\n", " environment: doc/environment.yml\n", " ```\n", "\n", " For further options see https://docs.readthedocs.io/en/latest/config-file/.\n", "\n", "1. Create a file named `doc/environment.yml`\n", " (or whatever you chose in the previous step)\n", " describing a\n", " [conda environment](https://docs.conda.io/projects/conda/en/latest/user-guide/tasks/manage-environments.html)\n", " like this:\n", "\n", " ```yaml\n", " channels:\n", " - conda-forge\n", " dependencies:\n", " - python>=3\n", " - pandoc\n", " - ipykernel\n", " - pip\n", " - pip:\n", " - nbsphinx\n", " ```\n", "\n", " It is up to you if you want to install `nbsphinx` with `conda` or with `pip`\n", " (but note that the `conda` package might be outdated).\n", " And you can of course add further `conda` and `pip` packages.\n", " You can also install packages directly from Github et al.,\n", " using a specific branch/tag/commit, e.g.\n", "\n", " ```yaml\n", " - pip:\n", " - git+https://github.com/spatialaudio/nbsphinx.git@master\n", " ```\n", "\n", "
\n", "\n", "Note\n", "\n", "The specification of the `conda-forge` channel is recommended because it tends to have more recent package versions than the default channel.\n", "\n", "
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Automatic Creation of HTML and PDF output on GitLab Pages\n", "\n", "When using GitLab pages, you can use nbsphinx by adding the file `.gitlab-ci.yml` to your repo and copying the following lines into this file:\n", "\n", "```yaml\n", "image: python:3-slim\n", "\n", "variables:\n", " PIP: python3 -m pip\n", " SPHINX: python3 -m sphinx -W --keep-going --color\n", "\n", "build-docs:\n", " stage: build\n", " script:\n", " - apt-get update -y\n", " - apt-get install -y --no-install-recommends pandoc\n", " - $PIP install -r doc/requirements.txt\n", " - $SPHINX -d doctrees doc html -b html\n", " - $SPHINX -d doctrees doc linkcheck -b linkcheck\n", " artifacts:\n", " when: always\n", " paths:\n", " - html\n", " - linkcheck/output.*\n", " \n", "pages:\n", " stage: deploy\n", " variables:\n", " GIT_STRATEGY: none\n", " script:\n", " - mv html public\n", " artifacts:\n", " paths:\n", " - public\n", " rules:\n", " - if: $CI_COMMIT_REF_NAME == $CI_DEFAULT_BRANCH\n", "```" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## HTML Themes\n", "\n", "The `nbsphinx` extension does *not* provide its own theme, you can use any of the available themes or [create a custom one](https://www.sphinx-doc.org/en/master/development/theming.html#creating-themes), if you feel like it.\n", "\n", "The following (incomplete) list of themes contains up to three links for each theme:\n", "\n", "1. The documentation (or the official sample page) of this theme (if available; see also the [documentation of the built-in Sphinx themes](https://www.sphinx-doc.org/en/master/usage/theming.html#builtin-themes))\n", "1. How the `nbsphinx` documentation looks when using this theme\n", "1. How to enable this theme using either `requirements.txt` or `readthedocs.yml` and theme-specific settings (in some cases)\n", "\n", "### Sphinx's Built-In Themes\n", "\n", "* `agogo`:\n", " [example](https://nbsphinx.readthedocs.io/en/agogo-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/agogo-theme^...agogo-theme)\n", "\n", "* [alabaster](https://alabaster.readthedocs.io/):\n", " [example](https://nbsphinx.readthedocs.io/en/alabaster-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/alabaster-theme^...alabaster-theme)\n", "\n", "* `bizstyle`:\n", " [example](https://nbsphinx.readthedocs.io/en/bizstyle-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/bizstyle-theme^...bizstyle-theme)\n", "\n", "* `classic`:\n", " [example](https://nbsphinx.readthedocs.io/en/classic-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/classic-theme^...classic-theme)\n", "\n", "* `haiku`:\n", " [example](https://nbsphinx.readthedocs.io/en/haiku-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/haiku-theme^...haiku-theme)\n", "\n", "* `nature`:\n", " [example](https://nbsphinx.readthedocs.io/en/nature-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/nature-theme^...nature-theme)\n", "\n", "* `pyramid`:\n", " [example](https://nbsphinx.readthedocs.io/en/pyramid-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/pyramid-theme^...pyramid-theme)\n", "\n", "* `scrolls`:\n", " [example](https://nbsphinx.readthedocs.io/en/scrolls-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/scrolls-theme^...scrolls-theme)\n", "\n", "* `sphinxdoc`:\n", " [example](https://nbsphinx.readthedocs.io/en/sphinxdoc-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/sphinxdoc-theme^...sphinxdoc-theme)\n", "\n", "* `traditional`:\n", " [example](https://nbsphinx.readthedocs.io/en/traditional-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/traditional-theme^...traditional-theme)\n", "\n", "### 3rd-Party Themes\n", "\n", "* [basicstrap](https://pythonhosted.org/sphinxjp.themes.basicstrap/):\n", " [example](https://nbsphinx.readthedocs.io/en/basicstrap-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/basicstrap-theme^...basicstrap-theme)\n", "\n", "* [better](https://sphinx-better-theme.readthedocs.io/):\n", " [example](https://nbsphinx.readthedocs.io/en/better-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/better-theme^...better-theme)\n", "\n", "* [bootstrap](https://sphinx-bootstrap-theme.readthedocs.io/):\n", " [example](https://nbsphinx.readthedocs.io/en/bootstrap-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/bootstrap-theme^...bootstrap-theme)\n", "\n", "* [bootstrap-astropy](https://github.com/astropy/astropy-sphinx-theme):\n", " [example](https://nbsphinx.readthedocs.io/en/astropy-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/astropy-theme^...astropy-theme)\n", "\n", "* [cloud/redcloud/greencloud](https://cloud-sptheme.readthedocs.io/):\n", " [example](https://nbsphinx.readthedocs.io/en/cloud-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/cloud-theme^...cloud-theme)\n", "\n", "* [dask_sphinx_theme](https://github.com/dask/dask-sphinx-theme):\n", " [example](https://nbsphinx.readthedocs.io/en/dask-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/dask-theme^...dask-theme)\n", "\n", "* [furo](https://github.com/pradyunsg/furo):\n", " [example](https://nbsphinx.readthedocs.io/en/furo-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/furo-theme^...furo-theme)\n", "\n", "* [guzzle_sphinx_theme](https://github.com/guzzle/guzzle_sphinx_theme):\n", " [example](https://nbsphinx.readthedocs.io/en/guzzle-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/guzzle-theme^...guzzle-theme)\n", "\n", "* [insipid](https://github.com/mgeier/insipid-sphinx-theme/):\n", " [example](https://nbsphinx.readthedocs.io/en/insipid-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/insipid-theme^...insipid-theme)\n", "\n", "* [maisie_sphinx_theme](https://github.com/maisie-dev/maisie-sphinx-theme):\n", " [example](https://nbsphinx.readthedocs.io/en/maisie-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/maisie-theme^...maisie-theme)\n", "\n", "* [pangeo](https://github.com/pangeo-data/sphinx_pangeo_theme/):\n", " [example](https://nbsphinx.readthedocs.io/en/pangeo-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/pangeo-theme^...pangeo-theme)\n", "\n", "* [pydata_sphinx_theme](https://pydata-sphinx-theme.readthedocs.io/):\n", " [example](https://nbsphinx.readthedocs.io/en/pydata-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/pydata-theme^...pydata-theme)\n", "\n", "* [python_docs_theme](https://github.com/python/python-docs-theme):\n", " [example](https://nbsphinx.readthedocs.io/en/python-docs-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/python-docs-theme^...python-docs-theme)\n", "\n", "* [pytorch_sphinx_theme](https://github.com/shiftlab/pytorch_sphinx_theme):\n", " [example](https://nbsphinx.readthedocs.io/en/pytorch-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/pytorch-theme^...pytorch-theme)\n", "\n", "* [sizzle](https://docs.red-dove.com/sphinx_sizzle_theme/):\n", " [example](https://nbsphinx.readthedocs.io/en/sizzle-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/sizzle-theme^...sizzle-theme)\n", "\n", "* [sphinx_book_theme](https://sphinx-book-theme.readthedocs.io/):\n", " [example](https://nbsphinx.readthedocs.io/en/sphinx-book-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/sphinx-book-theme^...sphinx-book-theme)\n", "\n", "* [sphinx_holoviz_theme](https://github.com/pyviz-dev/sphinx_holoviz_theme):\n", " [example](https://nbsphinx.readthedocs.io/en/holoviz-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/holoviz-theme^...holoviz-theme)\n", "\n", "* [sphinx_immaterial](https://github.com/jbms/sphinx-immaterial):\n", " [example](https://nbsphinx.readthedocs.io/en/immaterial-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/immaterial-theme^...immaterial-theme)\n", "\n", "* [sphinx_material](https://github.com/bashtage/sphinx-material):\n", " [example](https://nbsphinx.readthedocs.io/en/material-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/material-theme^...material-theme)\n", "\n", "* [sphinx_py3doc_enhanced_theme](https://github.com/ionelmc/sphinx-py3doc-enhanced-theme):\n", " [example](https://nbsphinx.readthedocs.io/en/py3doc-enhanced-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/py3doc-enhanced-theme^...py3doc-enhanced-theme)\n", "\n", "* [sphinx_rtd_theme](https://github.com/readthedocs/sphinx_rtd_theme):\n", " [example](https://nbsphinx.readthedocs.io/en/rtd-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/rtd-theme^...rtd-theme)\n", "\n", "* [typlog](https://github.com/typlog/sphinx-typlog-theme):\n", " [example](https://nbsphinx.readthedocs.io/en/typlog-theme/),\n", " [usage](https://github.com/spatialaudio/nbsphinx/compare/typlog-theme^...typlog-theme)\n", "\n", "If you know of another Sphinx theme that should be included here, please open an [issue on Github](https://github.com/spatialaudio/nbsphinx/issues).\n", "An overview of many more themes can be found at https://sphinx-themes.org/." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Using Notebooks with Git\n", "\n", "[Git](https://git-scm.com/) is extremely useful for managing source code and it can and should also be used for managing Jupyter notebooks.\n", "There is one caveat, however:\n", "Notebooks can contain output cells with rich media like images, plots, sounds, HTML, JavaScript and many other types of bulky machine-created content.\n", "This can make it hard to work with Git efficiently, because changes in those bulky contents can completely obscure the more interesting human-made changes in text and source code.\n", "Working with multiple collaborators on a notebook can become very tedious because of this.\n", "\n", "It is therefore highly recommended that you remove all outputs from your notebooks before committing changes to a Git repository (except for the reasons mentioned in [Pre-Executing Notebooks](pre-executed.ipynb)).\n", "\n", "If there are no output cells in a notebook, `nbsphinx` will by default execute the notebook, and the pages generated by Sphinx will therefore contain all the output cells.\n", "See [Controlling Notebook Execution](executing-notebooks.ipynb) for how this behavior can be customized.\n", "\n", "In the Jupyter Notebook application, you can manually clear all outputs by selecting\n", "\"Cell\" $\\to$ \"All Output\" $\\to$ \"Clear\" from the menu.\n", "In JupyterLab, the menu items are \"Edit\" $\\to$ \"Clear All Outputs\".\n", "\n", "There are several tools available to remove outputs from multiple files at once without having to open them separately.\n", "You can even include such a tool as \"clean/smudge filters\" into your Git workflow, which will strip the output cells automatically whenever a Git command is executed.\n", "For details, have a look at those links:\n", "\n", "* https://github.com/kynan/nbstripout\n", "* https://github.com/toobaz/ipynb_output_filter\n", "* https://tillahoffmann.github.io/2017/04/17/versioning-jupyter-notebooks-with-git.html\n", "* http://timstaley.co.uk/posts/making-git-and-jupyter-notebooks-play-nice/\n", "* https://web.archive.org/web/20191003081426/https://pascalbugnion.net/blog/ipython-notebooks-and-git.html\n", "* https://github.com/choldgraf/nbclean\n", "* https://jamesfolberth.org/articles/2017/08/07/git-commit-hook-for-jupyter-notebooks/\n", "* https://github.com/ResearchSoftwareActions/EnsureCleanNotebooksAction" ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.11.1" } }, "nbformat": 4, "nbformat_minor": 4 }