I have a question regarding Tensorflow:
Which loss function is used in tf.nn.sampled_softmax_loss?
I believe it's cross-entropy, but it is not written on the official website. Can anyone confirm my guess?
Asked
Active
Viewed 102 times
0
ibarrond
- 6,617
- 4
- 26
- 45
theabc50111
- 421
- 7
- 16
-
@ibarrond Yes, it is. Thank you very much!!! – theabc50111 Jul 06 '20 at 10:01
1 Answers
0
Based on this other question, it looks like it is cross entropy.
Besides, the main difference between sampled_softmax_loss and softmax_cross_entropy_with_logits (the standard cross_entropy loss in TF) is that the first only takes into account a subset V of your vocabulary to calculate your loss, while the second takes into account your entire vocabulary.
ibarrond
- 6,617
- 4
- 26
- 45