# Changelog

All notable changes to this project will be documented in this file.

## Unreleased

### New features

* Optional NATS notifier (`nats` feature): newly indexed files are published to NATS JetStream, one message per file, with the file URL as the message ID so publisher retries are deduplicated within the stream's duplicate window
    * Configured through `BGPKIT_BROKER_NATS_URL`, `BGPKIT_BROKER_NATS_USER`, `BGPKIT_BROKER_NATS_PASSWORD`, and `BGPKIT_BROKER_NATS_ROOT_SUBJECT`; disabled when the URL is unset
    * Publishing requires an existing JetStream stream covering the subject root (the broker does not create streams) and is emitted by the `serve` daemon; failed items are retried and reported without stopping the batch

### Bug fixes

* `serve --no-api` keeps running as a pure updater: the process previously exited immediately after spawning the updater thread because only the API path kept the main thread alive

## v0.13.1 - 2026-10-07

### Bug fixes

* The broker base URL from `BGPKIT_BROKER_URL` is normalized before use: surrounding whitespace and trailing slashes are trimmed, and an unset or blank value falls back to the public endpoint instead of producing an empty base URL (#111)
    * The resolution is covered by unit tests, including a check that `BgpkitBroker::default()` picks up and normalizes the environment variable (#111)

## v0.13.0 - 2026-10-06

### New features

* Consolidated the PostgreSQL Broker catalog into a single `broker` schema (#106)
    * The catalog that previously split across the `mrt` and `api` schemas now lives under `broker`, and the read views are exposed as `broker.file_search_view` and `broker.file_latest_view`
    * `migration/postgres_bootstrap/migrate_mrt_api_to_broker.sql` migrates an existing `mrt` + `api` database in place without rewriting rows and preserves the composite foreign key from `spectrum.processing` to the canonical Broker file identity; stop the Broker and Spectrum writers and take a verified PostgreSQL backup before running it
    * The bootstrap script now refuses an unsafe `--reset` when another schema has a foreign key into `broker` instead of cascading through it; SQLite-backed deployments are unaffected

### Bug fixes

* Periodic S3 backup no longer retries in a full-file loop on failure (#108, fixes #107)
    * The backup gate now advances on the last attempt (not the last success), so a failed backup waits for a full `BGPKIT_BROKER_BACKUP_INTERVAL_HOURS` window before the next attempt instead of re-running on every update tick
    * The S3 upload step retries up to 3 times with exponential backoff (2s initial, doubling) before giving up for the interval window

### Dependencies

* Updated `oneio` 0.24.2 -> 0.26 and `bgpkit-commons` 0.10 -> 0.13 (#109), clearing the quick-xml advisories ([RUSTSEC-2026-0194](https://rustsec.org/advisories/RUSTSEC-2026-0194.html), [RUSTSEC-2026-0195](https://rustsec.org/advisories/RUSTSEC-2026-0195.html)) and the suppaftp advisory ([RUSTSEC-2026-0271](https://rustsec.org/advisories/RUSTSEC-2026-0271.html)) carried by the previous dependency chain; the lockfile also moves `rustls` to 0.23.45, clearing [RUSTSEC-2026-0285](https://rustsec.org/advisories/RUSTSEC-2026-0285.html)
    * `cargo audit` reports no vulnerabilities on this lockfile; the remaining `proc-macro-error2` unmaintained warning does not fail the audit

## v0.12.1 - 2026-08-16

### Bug fixes

* Broker server now survives transient database outages (fixes the crash loop on restart) (#105)
    * Startup retries the database connection with exponential backoff instead of exiting on the first failure; a PostgreSQL restart no longer crash-loops the container until Docker's restart backoff happens to align with the database returning
    * Retries are configurable via `BGPKIT_BROKER_DB_CONNECT_RETRIES` (default 10) and `BGPKIT_BROKER_DB_CONNECT_BACKOFF_MS` (default 3000; doubles after each failure)
    * A failed latest-files read during an update round now skips that round instead of being treated as an empty database, which previously triggered a full bootstrap re-crawl of every collector on every update interval for the duration of the outage
    * `/latest` and `/missing-collectors` return 503 with the standard error body when the database read fails, instead of a misleading empty 200 response
    * `LocalBrokerDb::new` returns an error instead of panicking when SQLite cannot create the database file
* Fixed duplicate rows in PostgreSQL latest-file upserts (#104)
    * `update_latest_files` deduplicates the incoming batch by `(collector, data_type)` in memory before upserting, keeping the newest item per key; previously multiple same-type items from one collector in a single batch inserted duplicate rows, since the `ON CONFLICT (collector_id, data_type)` clause cannot deduplicate rows within a single `INSERT` statement

## v0.12.0 - 2026-07-27

### New features

* Added an opt-in PostgreSQL backend for self-hosted brokers
    * Selects PostgreSQL automatically when the database path or `BGPKIT_BROKER_POSTGRES_URL` begins with `pg://`, `postgres://`, or `postgresql://` (case-insensitive); any other path is treated as a local SQLite file
    * Configurable connection pool via `BGPKIT_BROKER_POSTGRES_MAX_CONNECTIONS`
    * SQLite remains the default backend; the container image is backend-neutral unless explicitly configured
    * PostgreSQL bootstrap requires pre-seeding the schema; SQLite users are unaffected
* Added a unified `DatabaseTarget` configuration path so the backend can be selected from either the positional CLI argument or environment variables (`BGPKIT_BROKER_POSTGRES_URL`, `BGPKIT_BROKER_SQLITE_PATH`)

### Updates

* Upgraded direct dependencies to current releases
    * `reqwest` 0.12 -> 0.13 (`rustls-tls-native-roots` feature replaced by `rustls`)
    * `sha2` 0.10 -> 0.11
    * `sqlx` 0.8 -> 0.9
    * `bgpkit-commons` 0.9 -> 0.10, `oneio` 0.20 -> 0.24.2, `scraper` 0.24 -> 0.27, `tabled` 0.20 -> 0.21, `tower-http` 0.6 -> 0.7, `axum-prometheus` 0.9 -> 0.10, `itertools` 0.14 -> 0.15
    * Resolved the `rsa` (RUSTSEC-2023-0071) advisory via the `sqlx` 0.9 upgrade; `fxhash` unmaintained warning removed via `scraper` 0.27
* Updated the Docker base image from `rust:1.90` to `rust:1.97`
* CI now publishes multi-architecture (`linux/amd64`, `linux/arm64`) container images
* Updated `route-views2` collector URL from `https://archive.routeviews.org/bgpdata` to `https://archive.routeviews.org/route-views2/bgpdata` to match RouteViews' directory rename ([announcement](https://www.routeviews.org/routeviews/2026/07/09/name-change-for-mrt-file-access/))
    * The old `/bgpdata` path remains available via HTTP symlink, but rsync users must use the new path
    * Existing databases need a manual `UPDATE collectors SET url = 'https://archive.routeviews.org/route-views2/bgpdata' WHERE name = 'route-views2'`

### Bug fixes

* Prevent storing entries with Unix epoch timestamp (1970-01-01) (fixes #97)
    * Added `MIN_VALID_TIMESTAMP` constant (1998-01-01) in `crawler/common.rs`
    * Crawlers filter out entries with timestamps before 1998-01-01 during parsing
* Fixed slow queries when no timestamp filters are provided
    * Added default 30-day time window when neither `ts_start` nor `ts_end` is specified
    * Prevents full table scans that caused timeouts on large databases
    * Returns recent data by default instead of starting from 1970
* Bounded SQLite connection-pool memory usage (fixes #101)
    * Reduced the default maximum from 10 to 2 connections per pool
    * Set SQLite's suggested per-connection page-cache maximum to 640 KiB
    * Added `BGPKIT_BROKER_SQLITE_MAX_CONNECTIONS` and `BGPKIT_BROKER_SQLITE_CACHE_SIZE_KIB` overrides
* Bounded memory used by broad SQLite searches
    * Added a covering collector/timestamp/type index for exact counts
    * Restored SQL-level `LIMIT`/`OFFSET` with the composite index so paginated queries stop early instead of streaming the full result set
    * Previous streaming approach held a pooled connection for the entire scan, exhausting the 2-connection pool under concurrent broad searches and hanging the service
* Added comma-separated `collector_id` filtering to the `/latest` endpoint
* Fixed S3 backup uploads on endpoints that require path-style object keys by updating `oneio` to 0.24.2

## v0.11.0 - 2025-03-23

### New collector

* Added RouteViews `locix.fra` collector to the supported collectors list
* Added RouteViews `ixpn.lagos` collector to the supported collectors list
* Added RouteViews `decix.fra` collector to the supported collectors list

### API improvements

* Added live SSE notifications at `GET {root}/events`
    * Emits `new_file` events with `BrokerItem` JSON payloads
    * Returns `503` when the updater service is disabled in the current process
* Added Prometheus metrics endpoint at `GET {root}/metrics`
    * Exposes `bgpkit_broker_http_requests_total` counter
    * Exposes `bgpkit_broker_http_requests_duration_seconds` histogram
    * Exposes `bgpkit_broker_http_requests_pending` gauge for active connections

### SDK improvements

* Added optional `sse` feature for subscribing to live broker notifications
    * Added `BgpkitBroker::subscribe_new_files()` async subscription API
    * Added `SseSubscriptionOptions` for client-side filtering by project, collector, and data type
    * Note: The `bgpkit-broker live` CLI command now uses SSE instead of NATS
* Added result caching for SDK queries
    * Added `BgpkitBroker::cache_dir()` builder method to enable disk caching
    * Cache key generated from SHA256 hash of query parameters
    * Cache files stored as JSON in specified directory
    * Allows offline usage and reduces API calls during development
    * Different broker instances share cache if query parameters match

### Code improvements

* Started the local API before the first updater pass completes so existing databases remain queryable during startup
* Stored canonical `url` and `ts_end` values in local database file metadata instead of reconstructing them on read
* Parameterized local database search and meta queries to avoid string interpolation in SQL
* Centralized timestamp, collector, project, data type, and page validation shared by SDK, API, and SSE paths
* Seeded default item types when initializing a local broker database
* Removed NATS notification feature and `async-nats` dependency to reduce attack surface

### Security

* Removed NATS feature and `async-nats` dependency
    * Eliminated 9 transitive dependency vulnerabilities (aws-lc-sys, quinn-proto, bytes, time)
    * Updated `bgpkit-broker live` command to use SSE subscription instead of NATS
    * Removed environment variables: `BGPKIT_BROKER_NATS_URL`, `BGPKIT_BROKER_NATS_USER`, `BGPKIT_BROKER_NATS_PASSWORD`, `BGPKIT_BROKER_NATS_ROOT_SUBJECT`
* Updated dependencies via `cargo update` to pull in security fixes

## v0.10.1 - 2025-12-03

### Configuration management

* Added `BrokerConfig` struct for centralized configuration management
    * Consolidates all environment variable configuration into a single struct
    * Provides `from_env()` method for loading configuration at startup
    * Includes `display_summary()` method for logging configuration state
    * Sub-configs: `CrawlerConfig`, `BackupConfig`, `HeartbeatConfig`, `DatabaseConfig`

### Crawler improvements

* Added configurable concurrency for crawler operations
    * `BGPKIT_BROKER_CRAWLER_COLLECTOR_CONCURRENCY` - Number of collectors to crawl simultaneously (default: 2)
    * `BGPKIT_BROKER_CRAWLER_MONTH_CONCURRENCY` - Number of months to crawl in parallel per collector (default: 2, primarily affects bootstrap)
* Reduced default concurrency from 5 collectors / 10 months to 2/2 to avoid rate limiting

### CLI improvements

* Added update timing and performance logging
    * Logs completion time, items inserted, and percentage of update interval used
    * Warns when update time exceeds 80% of interval or exceeds interval entirely
* Enhanced startup logging to display all non-secret configuration values
* Disabled ANSI color codes in log output for better compatibility with non-terminal environments

### Database improvements

* Added index on `meta.update_ts` column for faster meta table queries and cleanup operations

## v0.10.0 - 2025-12-02

### New collector

* Added RouteViews `crix.sjo` collector to the supported collectors list

### SDK improvements

* Added `get_snapshot_files()` method to get MRT files needed to construct routing table snapshots
    * Takes an array of collector IDs and a target timestamp
    * Returns `Vec<SnapshotFiles>` with RIB URL and ordered updates URLs for each collector
    * Finds the closest RIB dump before the target timestamp and all updates files between RIB and target
    * Useful for applications that need to reconstruct exact routing table state at a specific point in time

### Crawler improvements

* Added retry logic with exponential backoff for failed HTTP requests during crawling
    * Default: 3 retries with 1 second initial backoff (doubles each retry: 1s, 2s, 4s)
    * Configurable via `BGPKIT_BROKER_CRAWLER_MAX_RETRIES` and `BGPKIT_BROKER_CRAWLER_BACKOFF_MS`

### Database maintenance

* Added automatic cleanup of old meta table entries
    * Entries older than 30 days are automatically deleted after each database update
    * Configurable via `BGPKIT_BROKER_META_RETENTION_DAYS`

### Code improvements

* Replaced `.unwrap()` calls with proper error handling throughout the codebase
    * CLI now handles errors gracefully with informative error messages
    * Database operations log errors instead of panicking
    * Crawlers skip malformed entries instead of crashing
    * API endpoints handle invalid data gracefully

## v0.9.2 - 2025-11-18

### New collector

* add RouteViews `iix.cgk` collector to the supported collectors list
    * official RouteViews news: https://www.routeviews.org/routeviews/2025/11/14/new-collector-at-iix-jakarta-indonesia/

### Cli improvements

* fixed a shorthand parameter collision for `bgpkit-broker search` command
  * associated `-D` for `--data-type`, and `-d` for `--duration`

## v0.9.1 - 2025-11-05

### New collector

* add RouteViews `netnod.mmx` collector to the supported collectors list
    * official RouteViews news: https://www.routeviews.org/routeviews/2025/11/04/new-collector-at-netnod-stockholm-sweden-copenhagen-denmark/

### SDK improvements

* add user-agent with SDK library version to HTTP requests

### CLI improvements

* `bgpkit-broker serve` now starts the API server before the initial backup is complete, reducing starting time significantly

### Bug fixes

* **Collector validation improvements**: Fixed collector ID validation to be truly permissive
    * Unknown/new collectors are now allowed (permissive behavior as intended)
    * Collector IDs are properly normalized (trimmed, deduplicated, comma-joined)
    * Fixed multi-collector filtering in `latest()` method to correctly handle comma-separated lists
    * Example: `.collector_id("rrc00,route-views2")` now correctly matches items from either collector

## v0.9.0 - 2025-10-30

### SDK Changes

* **Total count support**: Added `query_total_count()` method to fetch total matching item count
    * New `query_total_count()` method returns total count without fetching items
    * `BrokerQueryResult` now includes optional `total` field for pagination support
    * Enables efficient count queries for pagination UI components

### API Changes

* **Search result enhancement**: Added `total` field to `/v3/search` endpoint response
    * API now returns the total count of matching items alongside paginated results
    * `BrokerSearchResult` includes `total` field for client-side pagination

### Code Improvements

* Refactored bootstrap download logging to centralize and clean redundant code
* Updated oneio dependency to version 0.20.0 with specific features

### Data Updates

* Added the following recent RouteViews collectors:
    * `hkix.hkg`
    * `ix-br.gru`

## v0.8.1 - 2025-09-01

### Improvements

* Updated dependencies to the latest versions

### Bug fixes

* Fixed incorrect database initialization schema error

### Data updates

* Added getafix.mnl collector
* Added ix-br2.gru collector

## v0.8.0 - 2025-08-17

### Breaking Changes

None - This release maintains API compatibility with previous versions.

### API Changes

None - This release maintains API compatibility with previous versions.

### Backend Changes

* **Periodic backup system**: Added automated database backup functionality to the serve command
    * Enabled via `BGPKIT_BROKER_BACKUP_TO` environment variable for backup destination
    * Supports both local file system and S3 destinations (e.g., `s3://bucket/path/backup.db`)
    * Configurable backup interval via `BGPKIT_BROKER_BACKUP_INTERVAL_HOURS` (default: 24 hours)
    * Backup-specific heartbeat notifications via `BGPKIT_BROKER_BACKUP_HEARTBEAT_URL`
    * Separate heartbeat endpoints for regular updates vs backup completion
    * Eliminates race conditions by running backups only after successful database updates

* **Configuration summary display**: Added startup configuration summary for better operational visibility
    * Displays periodic update status, API service configuration, backup settings, and heartbeat configuration
    * Shows S3 environment validation status when S3 backup destinations are configured
    * NATS notification status and configuration validation
    * Helps operators quickly verify service configuration at startup

* **Bootstrap sequence optimization**: Fixed duplicate database updates during bootstrap process
    * Eliminated redundant database update that occurred both during bootstrap and update thread startup
    * Streamlined bootstrap flow for cleaner startup sequence and reduced processing time

### SDK Changes

* **Shortcuts module**: Added convenience methods for common BGP data queries
    * `daily_ribs()` - Filter RIB files captured at midnight (00:00:00) for daily snapshots
    * `recent_updates(hours)` - Get BGP update files from the last N hours
    * `most_diverse_collectors(n, project)` - Find collectors with maximum ASN diversity using greedy algorithm
    * All shortcuts integrate seamlessly with existing filtering methods and support method chaining
    * Enhanced diversity algorithm selects collectors based on unique ASN coverage from full-feed peers
    * Project filtering supported for targeted RouteViews or RIPE RIS analysis

* **Configuration validation**: Restructured parameter validation for better error handling
    * Moved validation from configuration time to query execution time
    * Added `validate_configuration()` method with parameter checking
    * Validation includes timestamps, collectors, projects, data types, page numbers, and page sizes
    * Provides detailed error messages with valid options for invalid parameters
    * Maintains method chaining simplicity while ensuring data correctness at query time

* **Test performance**: Improved test suite execution speed
    * Updated validation tests to call `validate_configuration()` directly instead of `query()`
    * Modified `test_recent_updates` to test parameter configuration without network calls
    * Tests now run significantly faster while maintaining coverage and functionality

* **Timestamp parsing**: Enhanced timestamp parsing with timezone support and better validation
    * Added support for RFC3339 timestamps with timezone offsets (e.g., `2022-01-01T00:00:00+00:00`,
      `2022-01-01T05:00:00-05:00`)
    * Support for pure dates (e.g., `2022-01-01`), Unix timestamps, RFC3339 formats, and various date separators
    * Internal `parse_timestamp` function now returns `DateTime<Utc>` with proper timezone conversion
    * Validation occurs at query time with helpful error messages for invalid timestamp formats
    * Pure dates automatically converted to start-of-day UTC timestamps

* **Database tests**: Updated database tests to use temporary files with proper cleanup
    * Replace hardcoded test database paths with unique temporary file paths using system temp directory
    * Add automatic cleanup of SQLite database files including WAL and SHM files
    * Improve test isolation and prevent interference between test runs
    * Tests now suitable for CI/CD environments without leaving leftover files

## v0.7.11 - 2025-04-08

### Highlights

* NATS notifier is now configured via the following env variables
    * `BGPKIT_BROKER_NATS_URL`: the URL for the NATS server, such as `nats.broker.bgpkit.com`
    * `BGPKIT_BROKER_NATS_USER`: NATS server user name
    * `BGPKIT_BROKER_NATS_PASSWORD`: NATS server password
    * `BGPKIT_BROKER_NATS_ROOT_SUBJECT`: NATS server root subject, such as `public.broker`

## v0.7.10 - 2025-03-26

### Highlights

* add `route-views8` collector
* add `/missing_collectors` endpoint to check for collectors that have not been added yet
* remove `/docs` and `utopia` dependency to remove clutter
* freshen up dependencies

### Bug fixes

* fixed an issue where incorrectly formatted timestring may cause the API to panic

## v0.7.9 - 2025-03-24

### Highlights

* `bgpkit-broker serve` and `bgpkit-broker backup` commands now runs SQLite `ANALYZE` command to once to ensure the
  performance is up to date to all the recently inserted data.

## v0.7.8 - 2025-03-20

### Highlights

* `bgpkit-broker backup` command now supports a bootstrapping source database
    * this is useful to set up independent backup executions separate from the running API services

## v0.7.7 - 2025-03-07

### Highlights

* Fix installation instruction for cargo
    * Change `@0.7` to `@^0.7` to correctly use the latest `v0.7.x` version.
* Add recently added RouteViews collectors
    * new collectors are `interlan.otp` (Romania),`kinx.icn` (South Korea), and `namex.fco` (Italy)
    * users update the version to `v0.7.7` can run the same `bgpkit-broker update` command to automatically bootstrap
      data for these collectors

## v0.7.6 - 2024-10-31

### Highlights

* migrate default broker API endpoint to `https://api.bgpkit.com/v3/broker`
    * Full API docs is available at `https://api.bgpkit.com/docs`
* add `get_peers` to `BgpkitBroker` struct
    * fetches the list of peers for a given collector
    * allow specifying filters the same way as querying MRT files
    * available filter functions include:
        * `.peers_asn(ASN)`
        * `.peers_ip(IP)`
        * `.collector_id(COLLECTOR_ID)`
        * `.peers_only_full_feed(TRUE/FALSE)`
    * returns `Vec<BrokerPeer>`

```rust
#[derive(Debug, Clone, Eq, PartialEq, Serialize, Deserialize)]
pub struct BrokerPeer {
    /// The date of the latest available data.
    pub date: NaiveDate,
    /// The IP address of the collector peer.
    pub ip: IpAddr,
    /// The ASN (Autonomous System Number) of the collector peer.
    pub asn: u32,
    /// The name of the collector.
    pub collector: String,
    /// The number of IPv4 prefixes.
    pub num_v4_pfxs: u32,
    /// The number of IPv6 prefixes.
    pub num_v6_pfxs: u32,
    /// The number of connected ASNs.
    pub num_connected_asns: u32,
}
```

## v0.7.5 - 2024-08-23

### [NEW] deploy at fly.io

* add a deployment config file for fly.io

### Bugfix

* fix an issue where the API returns URL with additional `/bgpdata` for some new route-views collectors.

### Documentation

* improved documentation on deploying bgpkit-broker services.

## v0.7.4 - 2024-08-22

### Highlights

* add a new 30s timeout for fetching web page content for the crawler
    * the async `reqwest::get` function by default does not have a timeout and thus we could potentially stuck waiting
      forever.
* add new `max_delay_secs` parameter to the `/health` endpoint to allow user specify a maximum delay in seconds and
  the API will return error code 503 if the delay for the latest file timestamp (any file) is greater than the specified
  value.
    * this allows better monitoring for the API's health without sending heartbeats.

## v0.7.3 - 2024-08-14

### Hotfix

* fix an issue where the main thread waits for updater thread and never starts the API thread

## v0.7.2 - 2024-08-13

### Highlights

* panic if the cli updater thread failed for some reason
    * previously, the failed thread goes silently, and the main process continues running
* reduce logging if not configuring NATS notifier
    * previously, the missing notifier message appear at every fetch

## v0.7.1 - 2024-08-05

### Highlights

* updated the `bgpkit-broker update` command to allow bootstrapping new collectors on demand
* a number of new RouteViews collectors have been added
    * `amsix.ams` `cix.atl` `decix.jhb` `iraq-ixp.bgw` `pacwave.lax` `pit.scl` `pitmx.qro` `route-views7`
* added a new `allow_invalid_cert` function to the constructor and deprecated the `disable_ssl_check` function
    * they work the same way, but the new function name is more accurate
* constructor also checks for `ONEIO_ACCEPT_INVALID_CERTS=true` environment variable to allow invalid certs (not
  recommended, use at your own risk)
* improved project filter. it now matches the name of the collector to project names
    * this works with the newly added RouteViews collectors whose names do not prefix with `route-views`

## v0.7.0 - 2024-06-18

### [NEW] NATS notification

Added new-file notification by publishing newly indexed BGP MRT file meta information in JSON format to user-specified
NATS server.

The NATS URL and credentials is configured via environment variables:

* `BGPKIT_BROKER_NATS_URL` like `nats://nats.bgpkit.com:4222` (default)
* `BGPKIT_BROKER_NATS_ROOT_SUBJECT` such as `public.broker.` (default)

The notification is published to `public.broker.{PROJECT}.{COLLECTOR}.{DATA_TYPE}` where

* `PROJECT` is `riperis` or `route-views`
* `COLLECTOR` is the route collector IDs like `rrc00` or `route-views2`
* `DATA_TYPE` is `rib` or `updates`

Example of what a subscriber can be notified for:

* `public.broker.>`: any new MRT files
* `public.broker.route-views.>`: new RouteViews updates files
* `public.broker.rrc00.rib`: new RIPE RIS rrc00 RIB dump files
* `public.broker.*.rib`: any new RIB dump files

This PR also adds a new subcommand `bgpkit-broker live` that listens to the specified NATS server for new file
notification.

```
Streaming live from a broker NATS server

Usage: bgpkit-broker live [OPTIONS]

Options:
      --no-log             disable logging
  -u, --url <URL>          URL to NATS server, e.g. nats://localhost:4222. If not specified, will try to read from BGPKIT_BROKER_NATS_URL env variable
      --env <ENV>          
  -s, --subject <SUBJECT>  Subject to subscribe to, default to public.broker.>
  -p, --pretty             Pretty print JSON output
  -h, --help               Print help
  -V, --version            Print version
```

### [NEW] `bgpkit-broker doctor` subcommand

Added `bgpkit-broker doctor` subcommand that checks the broker instance status and missing collectors.

```text
Check broker instance health and missing collectors

Usage: bgpkit-broker doctor [OPTIONS]

Options:
      --no-log     disable logging
      --env <ENV>  
  -h, --help       Print help
  -V, --version    Print version
```

Example output:

```text
checking broker instance health...
        broker instance at https://api.broker.bgpkit.com/v3 is healthy

checking for missing collectors...
missing the following collectors:
| project    | name         | country         | activated_on        | data_url                                           |
|------------|--------------|-----------------|---------------------|----------------------------------------------------|
| routeviews | decix.jhb    | Malaysia        | 2022-12-20 12:00:00 | http://archive.routeviews.org/decix.jhb/bgpdata    |
| routeviews | pacwave.lax  | United States   | 2023-03-30 12:00:00 | http://archive.routeviews.org/pacwave.lax/bgpdata  |
| routeviews | pit.scl      | Chile           | 2023-08-31 23:45:00 | http://archive.routeviews.org/pit.scl/bgpdata      |
| routeviews | amsix.ams    | The Netherlands | 2024-02-22 23:20:00 | http://archive.routeviews.org/amsix.ams/bgpdata    |
| routeviews | pitmx.qro    | Mexico          | 2024-02-23 22:15:00 | http://archive.routeviews.org/pitmx.qro/bgpdata    |
| routeviews | iraq-ixp.bgw | Iraq            | 2024-04-13 00:01:00 | http://archive.routeviews.org/iraq-ixp.bgw/bgpdata |
```

### [NEW] Heartbeat URL support

If `BGPKIT_BROKER_HEARTBEAT_URL` environment is set, when running the `bgpkit-broker serve` subcommand, the instance
will periodically send a GET request to the configured heartbeat URL.

### [NEW] `bgpkit-broker latest` subcommand

Added `latest` subcommand to CLI to display latest MRT files for all collectors.

### Developer experience improvements

- add `.is_rib()` to `BrokerItem` struct
- add strict ordering definition for `BrokerItem` struct

An array of `BrokerItem`s can be sorted with the following order:

1. smaller timestamp before larger timestamp
2. RIB before updates
3. then alphabetical order on collector ID (route-views before rrc)

### Breaking changes

- switch to `rustls` as the default TLS backend

## V0.6.1

### What's Changed

* switch http lib to reqwest from ureq by @digizeph in https://github.com/bgpkit/bgpkit-broker/pull/20

**Full Changelog**: https://github.com/bgpkit/bgpkit-broker/compare/v0.6.0...v0.6.1