Challenges in Aggregating Outputs from Classifiers Trained on Subsets of Classes
I’m currently working on a project involving several classifiers, each trained on a subset of classes. These classifiers are designed to handle different aspects of the classification task, but I’m facing a challenge when it comes to aggregating their outputs into a single prediction. For example, if one classifier is responsible for distinguishing between classes 0 and 1, and another handles classes 2 and 3, how can we effectively combine their results when the correct answer belongs to class 1? Our initial approach was to use an "other" class to indicate when an input doesn’t belong to a classifier’s assigned classes, but this did not yield the desired results. We are now exploring the possibility of implementing an additional head for detecting out-of-distribution classes, but we’re looking for a more efficient and streamlined solution. Has anyone encountered a similar issue or have any suggestions for effectively aggregating outputs from multiple classifiers? Thank you for your assistance!