Cross Validated
2024-02-02 17:00 UTC
By Boby
AI-113-20240202-social-media-9ca475c7
How to combine soft-max value from two or more neural networks
Consider a scenario where we have some input variable $X$ (maybe an image), which goes through several noisy path and we generate $K$ noisy observations: \begin{align} Y_i = X_i +Z_i, i \in \{1,\ldots, K\} \end{align} where noises are independent. Here I am assuming additive structure but it doesn't have to be. Suppose that I use the same neural network on $Y_i$ 's to classify. Also, suppose that I have access to the soft-max values In particular, let $p_i$ be the soft-max value for input $Y_i$ , Question: How do I combine these values in the best way to determine my class? One option is \begin{align} p_{new} = \frac{1}{K} \sum_{i=1}^K p_i \end{align} One can also just threshold at $0.5$ and find the majority. I am looking for an answer that would have some theoretical backing.
Consider a scenario where we have some input variable $X$ (maybe an image), which goes through several noisy path and we generate $K$ noisy observations: \begin{align} Y_i = X_i +Z_i, i \in \{1,\ldots, K\} \end{align} where noises are independent. Here I am assuming additive structure but it doesn't have to be. Suppose that I use the same neural network on $Y_i$ 's to classify. Also, suppose that I have access to the soft-max values In particular, let $p_i$ be the soft-max value for input $Y_i$ , Question: How do I combine these values in the best way to determine my class? One option is \begin{align} p_{new} = \frac{1}{K} \sum_{i=1}^K p_i \end{align} One can also just threshold at $0.5$ and find the majority. I am looking for an answer that would have some theoretical backing.
Full article content could not be extracted automatically. Read the original below.
Source:
Cross Validated
· stats.stackexchange.com