--- name: benchmark-suite-manager description: Manage and execute mathematical benchmark suites allowed-tools: - Bash - Read - Write - Edit - Glob - Grep metadata: specialization: mathematics domain: science category: reproducibility phase: 6 --- # Benchmark Suite Manager ## Purpose Provides management and execution capabilities for mathematical benchmark suites for algorithm validation. ## Capabilities - Standard benchmark access (Matrix Market, NIST, etc.) - Custom benchmark generation - Performance profiling - Accuracy validation - Comparison against reference solutions - Statistical analysis of results ## Usage Guidelines 1. **Benchmark Selection**: Choose appropriate standard benchmarks 2. **Custom Generation**: Create problem-specific benchmarks 3. **Validation**: Compare against known solutions 4. **Statistical Analysis**: Properly analyze performance data ## Tools/Libraries - Matrix Market - NIST Digital Library - SuiteSparse Matrix Collection