It’s the mean. At least in Lucene. Using median would be an interesting experime... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

softwaredoug 76 days ago | parent | context | favorite | on: Understanding the BM25 full text search algorithm

It’s the mean. At least in Lucene. Using median would be an interesting experiment.

Do you know of a search dataset with very large document length differences? MSMarco for example is pretty consistent in length.

MPSimmons 74 days ago [–]

Was just thinking about some of the docs we have at work, and how most are relatively short ( probably < 10 pages) and some are like... 200+ page government things

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact