Is a neural network consisting of a single softmax classification layer only a linear classifier?
![Image](https://lh4.googleusercontent.com/-Eg6leNBl_vc/AAAAAAAAAAI/AAAAAAAAAAA/AB6qoq3bFMz4n7btOcpNfbmsRl26i2QPXA/mo/photo.jpg?sz=32)
3
Since the softmax function is a generalization of the logistic function it is continuous and non-linear. So the output of the softmax layer is: softmax( weight_matrix * input_activation) weight_matrix * input_activation is purely linear combination of features. The question is: if the application of the softmax activation still yields in a linear classifier or is the model then capable of representing non-linear functions?
neural-networks generalized-linear-model softmax
share | cite | improve this question
asked Nov 22 at 14:07
tamtam_
36 3