It is a popular activation function as observed from literature. In softmax activation function the exponential of the input signal are considered. Further, the sum of all these values are computed. Next to it the ratio of the exponential to sum of exponential are evaluated as the output function. The advantage of this function is the output probabilities. The range of probabilities varies between 0 and 1. Mathematically softmax activation function can be represented assj=exj∑i=1nexn,(13.6)
where the input is x and the output value of s is between 0 and 1 and their sum is equal to 1.
Leave a Reply