library_name: PyChemAuth
license: other
license_name: nist
license_link: https://github.com/mahynski/pychemauth/blob/main/LICENSE.md
pipeline_tag: image-classification
tags:
- PyChemAuth
datasets:
- mahynski/pgaa-sample-gadf-images
language:
- en
Summary
This is an OpenSetClassifier Model from PyChemAuth. The closed-set classifier component is a pre-trained (imagenet) convolutional neural network base (nasnetmobile) with a "CAM" head (global average pooling + 1 dense layer) that was trained on the dataset below. This classified was fixed, then a softmax out-of-distribution (OOD) detector was trained to recognized OOD samples.
Training Dataset
This model was trained on the mahynski/pgaa-sample-gadf-images dataset.
Of the 13 Material classes, 3 were considered "unknown" (Carbon Powder, Phosphate Rock, Zircaloy) during training. The OSR model was still able to use these
as "known unknowns" during cross-validation to select optimal OOD hyperparameters (e.g., alpha). Test set performance is illustrated below.
Classifier Training
The closed set classifier was trained using cyclical learning rates, and its performance is summarized below. The validation set used here is the test set in mahynski/pgaa-sample-gadf-images dataset, the same used to compute the confusion matrix above.
OOD Training
The classifier used here corresponds to Model 2 below; different columns indicate its combination with different OOD detectors. All "known" classes (0-9) from the training set are shown in blue, all "unknown" classes (10-12) from both the test and training sets are shown in orange as OOD.
