Oleg Zabluda's blog
Thursday, April 27, 2017
 
“Three new graphical models for statistical language modelling” (2007) A. Mnih, G. E. Hinton
“Three new graphical models for statistical language modelling” (2007) A. Mnih, G. E. Hinton
"""
4. A Log-Bilinear Language Model

the model predicts a feature vector for the next word by computing a linear function of the context word feature vectors. Then it assigns probabilities to all words in the vocabulary based on the similarity of their feature vectors to the predicted feature vector as measured by the dot product.
"""
https://www.cs.toronto.edu/~amnih/papers/threenew.pdf
https://www.cs.toronto.edu/~amnih/papers/threenew.pdf

Labels:


| |

Home

Powered by Blogger