Hi Jeremy (& Sebastian of course), this is an amazing contribution to the state ... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

timClicks on May 16, 2018 | parent | context | favorite | on: State-of-the-art text classification with universa...

Hi Jeremy (& Sebastian of course), this is an amazing contribution to the state of the art!

I haven't read things in depth, but am curious - how do these models cope with out of vocabulary terms?

madisonmay on May 16, 2018 [–]

Initially embeddings of OOV terms are initialized to mean embeddings, and then the language model fine-tuning step allows the model to adjust these values.

See [18] here: https://github.com/fastai/fastai/blob/master/courses/dl2/imd....

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact