NCE Loss¶
This tutorial shows how to use nce-loss to speed up multi-class classification when the number of classes is huge.
You can get the source code for this example on GitHub.
Toy Examples¶
- toy_softmax.py. A multi class example using softmax output
- toy_nce.py. A multi-class example using nce loss
Word2Vec¶
- word2vec.py. A CBOW word2vec example using nce loss
Run word2vec.py with the following command:
./get_text8.sh
python word2vec.py
LSTM¶
- lstm_word.py. An LSTM example using nce loss
Run lstm_word.py with the following command:
./get_text8.sh
python lstm_word.py
References¶
For more details, see http://www.jianshu.com/p/e439b43ea464 (in Chinese).
