fastcrw-aio
dub19/fastcrw-aio:latest
https://hub.docker.com/r/dub19/fastcrw-aio
bridge
sh
false
https://github.com/wgross19/fastcrw-aio/issues
https://github.com/wgross19/fastcrw-aio
fastcrw-aio bundles crw-server v0.31.0 (the crw web-content research and crawl engine) with the LightPanda JS renderer under s6 supervision. It exposes a REST API (default port 3000) for scraping, crawling, mapping, extracting, parsing, and search/research over URLs.
First run:
- The API listens on port 3000 (Web UI Port on the LAN). Keep the API Port env var aligned with the host port you publish if you change it.
- Set the SearXNG URL (CRW_SEARCH__SEARXNG_URL) to an external SearXNG instance with its JSON API enabled to activate the /v1/search and research endpoints. Scrape, Crawl, Map, Extract, and Parse work without it.
- LightPanda (bundled, in-container) is the default renderer. To use the heavy Chrome tier, set the Renderer Mode to chrome and supply an external CDP endpoint; Chrome is not bundled.
- Persistent configuration lives under /config (runtime crw config), and application data under /data.
Hidden advanced settings let you add optional OpenAlex and Semantic Scholar API keys, tune the search engines, gate the API with API keys, and cap memory limits.
### 2026-08-24
- Generated from CHANGELOG.md during release preparation. Do not edit manually.
- Dockerfile builds crw-server v0.31.0 + LightPanda + s6
- Replace template README with fastcrw product docs
- S6 crw-server + lightpanda services and cont-init runtime config
- Bundle AIO-tailored config.docker.toml matching /docker-compose/fastcrw
- Author fastcrw-aio.xml defaults and advanced toggles
- Register fastcrw-aio for aio-fleet (dub19 image, us/crw monitor)
- Make fastcrw-aio trunk checks pass
- Restore sources and CA bundle in runtime image
- Use Docker Hub base namespace
- Pin published aio-base digest
- Bootstrap Unraid App Factory framework
- Rename Unraid template to fastcrw-aio.xml
- Allow full image build in integration gate
- Use publish image tag in integration smoke
- Enable fastcrw catalog sync
Tools:Utilities
http://[IP]:[PORT:3000]
https://raw.githubusercontent.com/wgross19/awesome-unraid/main/fastcrw-aio.xml
https://raw.githubusercontent.com/wgross19/awesome-unraid/main/icons/fastcrw-aio.png
crawler scraper crw-server lightpanda searxng research scraping crawl map extract parse
An external SearXNG instance with the JSON API enabled is required for the search and research endpoints; scrape, crawl, map, extract, and parse work without it.
Support wgross19 on GitHub Sponsors.
https://github.com/sponsors/wgross19
bridge
3000
3000
tcp
/mnt/user/appdata/fastcrw-aio/config
/config
rw
/mnt/user/appdata/fastcrw-aio/data
/data
rw
3000
3000
auto
2g
arxiv,crossref,google scholar,semantic scholar
github