# Spot Check Report Generated by `scripts/04_apply_corrections.py`. Four independent agents web-checked Department, Description and Recommendation against the first pass. A row counts as right only if all three fields passed. A row marked unrecognized that could in fact be identified counts as wrong. The staff-type relabel and the two consistency changes are excluded, because they are not first-pass errors. ## First-pass accuracy | Measure | Verified set | Random sample | |---|---|---| | Rows checked | 33 | 30 | | Rows fully right | 26 (78.8%) | 24 (80.0%) | | 95% range | 62.2% to 89.3% | 62.7% to 90.5% | | Department right | 29 of 33 | 26 of 30 | | Description right | 26 of 33 | 26 of 30 | | Recommendation right | 33 of 33 | 24 of 30 | | Source not found | 2 | 6 | ## Accuracy by first-pass confidence | First-pass confidence | Verified set | Random sample | |---|---|---| | High or Medium | 24 of 24 | 19 of 21 | | Low | 2 of 9 | 5 of 9 | Most failures were Low rows that could in fact be identified. The two High or Medium failures are lines 42 and 45. ## Changes by type | Type | Vendors | Field changes | |---|---|---| | verification | 13 | 62 | | consistency | 2 | 4 | | staff_relabel | 33 | 99 | ## Rows that failed the check | Set | Line | Vendor | Failed fields | |---|---|---|---| | verified | 20 | Big Frontier Pty Ltd (Cult Of Monday) | Department, Description | | verified | 32 | Veniture D.O.O. | Department, Description | | verified | 38 | Nefron - Obrt Za Poslovne Usluge | Description | | verified | 65 | Pingo D.O.O. | Description | | verified | 74 | Bijeli Pijesak Obrt Za Poslovno Savjetovanje | Description | | verified | 75 | Ramiro D.O.O. | Department, Description | | verified | 79 | Emerge Development Consultancy Ltd | Department, Description | | random | 42 | Agram Life Osiguranje D.O.O. | Recommendation | | random | 45 | Care Health Insurance Company Limited | Recommendation | | random | 146 | Good Game Global D.O.O. | Department, Description, Recommendation | | random | 251 | Merchandise Ltd | Department, Description, Recommendation | | random | 337 | Kat'S Kitchen D.O.O. | Department, Description, Recommendation | | random | 381 | Harissa D.O.O. | Department, Description, Recommendation | ## How to read this - The random sample is the better estimate for the untested rows, but 30 rows give a wide range. - Passing doesn't always mean confirmed. Rows with no source passed because nothing contradicted them. - Lines 42 and 45 failed on a reading of the rubric. The vendors were described correctly. - Line 367 (Istra Wine) passed, but no such company was found, so its description rests on the name.