How large is the index? How do you manage that between RAM or SSD? | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

ramoz on Feb 20, 2022 | parent | context | favorite | on: Show HN: Full text search on 630M US court cases

How large is the index?

How do you manage that between RAM or SSD?

richardbarosky on Feb 20, 2022 [–]

Search - Index is ~373GB. AMD Epyc 7371 - 16c/32t - 3.1 GHz/3.8 GHz. 512 GB ECC 2400 MHz. 2×1.92 TB SSD NVMe

Highlight - Index is ~620GB. Xeon-D 2141I - 8c/16t - 2.2 GHz/3 GHz. 64 GB ECC 2133 MHz. 2×1.92 TB SSD NVMe

Search and highlighting handled async from queue.

ramoz on Feb 20, 2022 | [–]

Awesome insight, and site. Thanks

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact