# Capability evaluation — 20261029-091714

Profile: **standard** · started 2026-10-29T09:17:14 · 4 scenarios · k=1

## Protocol

| item | value |
|---|---|
| source_commit | `858a175b` |
| binary | `/Users/qingyun/Documents/GitHub/blade-deepseek/target/release/orca` |
| binary_sha256 | `430fffce49fabe41` |
| model | `deepseek-flash (effort max)` |
| host | `darwin` |

## Axes

### Axis B

| scenario | rung | difficulty | attempts | passes | pass rate | 95% CI |
|---|---|---|---|---|---|---|
| B-l1-single-file | 1 | 1.0 | 1 | 1 | 1.0 | [0.2065, 1.0] |
| B-l2-three-files | 2 | 2.0 | 1 | 1 | 1.0 | [0.2065, 1.0] |
| B-l3-ten-files | 3 | 3.0 | 1 | 1 | 1.0 | [0.2065, 1.0] |
| B-l5-hidden-requirement | 5 | 5.0 | 1 | 1 | 1.0 | [0.2065, 1.0] |

## Failure taxonomy

| class | count |
|---|---|

## How to reproduce

```
python3 scripts/eval/capability/run.py --record --out /Users/qingyun/Documents/GitHub/blade-deepseek/jobs/capability/20261029-091714
```