--- namespace: aiwg name: diversity-tuning description: Interactive tuning of Verbalized Sampling diversity parameters with preset management and A/B comparison version: 1.0.0 platforms: [all] --- # Diversity Tuning Skill ## Triggers Alternate expressions and non-obvious activations (primary phrases are matched automatically from the skill description): - "mode collapse" → RLHF pattern mitigation via diversity tuning - "RLHF collapse" → same - "VS parameters" → Verbalized Sampling parameter adjustment shorthand ## Purpose Interactively tune Verbalized Sampling parameters to find the right diversity level for a given task. ## Parameters | Parameter | Default | Range | Description | |-----------|---------|-------|-------------| | k | 5 | 3-20 | Number of responses to generate | | threshold | 0.1 | 0.01-1.0 | Probability filter threshold | | variant | standard | standard/cot/multi | VS prompt variant | ## Presets | Preset | k | threshold | variant | Use Case | |--------|---|-----------|---------|----------| | conservative | 3 | 1.0 | standard | Minimal diversity, high confidence | | moderate | 5 | 0.1 | standard | Balanced (default) | | creative | 8 | 0.05 | cot | High diversity for ideation | | maximum | 12 | 0.01 | multi | Maximum exploration | ## Usage ``` # Apply a preset "tune diversity to creative" # Custom parameters "set diversity k=8 threshold=0.05" # A/B comparison "compare diversity: moderate vs creative for tagline generation" ``` ## A/B Comparison Mode When comparing presets: 1. Generate outputs using preset A 2. Generate outputs using preset B 3. Show side-by-side comparison 4. Measure diversity metrics: - Unique n-gram ratio - Average pairwise edit distance - Semantic cluster count 5. Recommend the better preset for the task ## References - @$AIWG_ROOT/agentic/code/addons/aiwg-utils/rules/vague-discretion.md — Measurable diversity thresholds and tuning criteria - @$AIWG_ROOT/agentic/code/addons/aiwg-utils/rules/instruction-comprehension.md — Parsing tuning parameters accurately - @$AIWG_ROOT/docs/extensions/overview.md — Extension system architecture - @$AIWG_ROOT/agentic/code/addons/voice-framework/README.md — Voice framework for style diversity context