YUREI RESEARCH
← Return to research library

corrective panel transfer

zenith-010negativecomplete

Does adding an approved Inventory-only and closed-panel development batch fix the cross-batch false-positive behavior of the frozen MobileNet V3 Small panel classifier without spending a fresh holdout?

computer-visionguild-wars-2holdoutnegative-resultpanel-recognitionprivacy

Labnote 010: corrective panel transfer

Question

Does adding an approved Inventory-only and closed-panel development batch fix the cross-batch false-positive behavior of the frozen MobileNet V3 Small panel classifier without spending a fresh holdout?

Method

  • Private input: four approved, structurally masked development batches only.
  • Corrective batch: 12 Small-UI observations containing eight Inventory-only
  • states and four closed-panel negatives.

  • Spent and future holdouts: not transferred to the execution environment and not read by the
  • experiment.

  • Model: ImageNet-pretrained MobileNet V3 Small with frozen backbone;
  • classifier head only.

  • Augmentation: bounded translation, scale, brightness, contrast, and
  • saturation.

  • Evaluation: four leave-one-batch-out folds, 18 epochs per fold.
  • Accelerator: RTX 4070 through a non-preemptive accelerator lease.
  • Internal execution record retained; identifier withheld.

Result

Held batchExact accuracyHero TP/FP/FNInventory TP/FP/FN
0015/9 (55.6%)7/0/02/4/0
0027/9 (77.8%)7/0/02/1/1
0039/12 (75.0%)7/1/17/1/0
004 corrective8/12 (66.7%)0/4/06/0/2

Aggregate exact accuracy was 29/42 (69.0%). The job completed on CUDA with exit code 0 and no stderr. The scheduler and compute broker remained healthy with zero restarts, and the accelerator lease was released normally.

Decision

Reject this corrective model and do not spend a fresh holdout. The new batch exposed rather than repaired cross-environment confounding: the model produced four false Hero detections in a batch containing no Hero examples, missed two Inventory states there, and regressed to four false Inventory detections on the first batch. No fold reached 80% exact accuracy.

Do not respond with more epochs or another blind classifier-head run on the same corpus. The next development slice should separate panel evidence into localized regions, add visually diverse negatives for each class, and freeze a development-only calibration gate before any new holdout is collected or read.