---
name: alma-scraper
description: Intelligent scraper for Australian youth justice sources. Discovers, extracts, and learns from government, Indigenous, research, and media sources.
---

# ALMA Intelligent Scraper

## When to Use
- Finding new youth justice information
- Updating ALMA intelligence
- Discovering new sources
- Analyzing coverage gaps
- Checking what's new in youth justice

## Commands

| Command | Purpose | Duration |
|---------|---------|----------|
| `quick` | Top 10 high-value sources | 5 min |
| `deep` | All 50+ sources with discovery | 30-60 min |
| `discover` | Follow discovered links | Variable |
| `source "QLD"` | Deep dive specific jurisdiction | 15 min |
| `gaps` | Show coverage gaps | 2 min |
| `status` | Current knowledge state | Instant |

## Learning Cycle

```
SCRAPE → EXTRACT → EVALUATE → LEARN → STORE
         (Claude)   (Quality)  (Patterns)
```

## Quality Signals

| Signal | Weight |
|--------|--------|
| Relevance (AU youth justice?) | 30% |
| Novelty (new info?) | 25% |
| Specificity (concrete details?) | 20% |
| Evidence (research backed?) | 15% |
| Actionability (useful?) | 10% |

## Priority Formula
```
priority = (quality × 0.4) + (freshness_need × 0.3) + (coverage_gap × 0.3)
```

## Sacred Boundaries

**Never scrape:** Private info, court records, social media, paywalled
**Always mark:** Community Controlled, Indigenous orgs, cultural knowledge
**Always check:** Consent level, cultural authority, data sovereignty

## File References

| Need | Reference |
|------|-----------|
| Database schema | `references/database-schema.md` |
| Extraction patterns | `references/extraction-patterns.md` |
| Coverage tracking | `references/coverage-tracking.md` |
| Implementation code | `references/implementation.md` |