FashionShift

Classify a garment image with three trained models and route it through a simulated sorting gate, right in your browser - then see exactly how well they work: clean accuracy, calibration, abstention, and behaviour when the images shift.

Live bench

Random images from the untouched 10,000-image official test set. Top line is the dataset truth; chips show each model's call. Inference runs in your browser right now (weights embedded, nothing leaves the page). Raise the abstain threshold and low-confidence calls go grey.

0.00

Measured results — untouched official test set (10,000 images)

ModelAccuracyMacro F1NLLBrierECEParams

NLL = negative log-likelihood, ECE = expected calibration error (15 bins). Lower is better for NLL, Brier, ECE. The augmented CNN trades a little clean accuracy for translation robustness — see the stress lab.

Confusion matrix

Per-class F1

Calibration (reliability)

Bars: mean confidence per bin. Line: actual accuracy. A calibrated model hugs the diagonal.

Coverage vs risk (abstention)

Error rate on the kept predictions as the confidence threshold rises. Confidence helps — but it is not a safety net (see stress lab).

Failure gallery

Real misclassifications from the untouched test set (augmented CNN). Shirt vs T-shirt/top vs Pullover confusions dominate — the weak classes in every model.

Stress lab — damage the input, watch the models

Apply a perturbation to a live batch of test images. Inference re-runs in your browser immediately. The full-audit numbers below were measured over all 10,000 test images during evaluation (seeded, reproducible).

Full-test stress audit (10,000 images, seeded)

PerturbationModelAccuracyMacro F1Mean conf (correct)Mean conf (wrong)

Key finding: confidence stays high even when the model is wrong under stress — abstaining on confidence alone does not catch shifted inputs.

Classify a garment image

Any PNG or JPG. The pipeline shows exactly what the models see: grayscale, centered, scaled to 28×28. White-on-dark is expected; tick invert if your sketch is dark-on-light.

Drop an image here or click to choose
0.85

What this can and cannot tell you

The models know ten classes of 28×28 grayscale catalog clothing photos. A phone photo, a drawing, or a different garment style is out of distribution: expect confident nonsense. That is exactly the behaviour this workbench exists to expose.

Sorting-gate simulator, benchmark data only. The gate routes each garment to an auto-sort bin (its predicted class) when confidence clears the threshold, otherwise to manual review - the same way a confidence-gated conveyor line would act. This is a study in routing logic, not factory-ready QC: on 28×28 benchmark photos, confidence does not prove reliable physical sorting, defect detection, or calibrated safety. Under shifted inputs the models stay confidently wrong (see the stress lab), so a real gate misroutes exactly when it looks sure.

Batch import (CSV)

One image per row: 784 comma-separated pixel values 0–255, optionally followed by a true label 0–9 (header row allowed). Validated before anything runs.

Drop a CSV here or click to choose

Session history

Saved in your browser only (localStorage). Nothing is uploaded anywhere.

WhenKindDetail

Model card