name: Benchmarks (Tier 3) # Scheduled, cost-capped external benchmarks. # Not run per-commit because the cloud tracks cost real warehouse money; the free # DuckDB tracks (ADE-bench --db duckdb, Spider2.0-DBT) lead. A pass-rate or # cost/turn regression blocks a release. on: workflow_dispatch: {} schedule: # Weekly. Pre-release runs are triggered from the release workflow. - cron: "0 6 * * 1" permissions: contents: read jobs: placeholder: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - name: Tier-3 harness lands with v0.3 run: | echo "ADE-bench plugin-set runner (vs none / vs all-dbt-skills)," echo "Spider2.0-DBT (lead) + Lite/Snow, and the SemBench seed are added" echo "with v0.3 under a cost ceiling. See benchmarks/ for the runbooks."