Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Impressive performance. In your experience, is there a range of vector dimension for faster search results?


We have not run microbenchmarks to see what dimension ranges perform best but those are coming soon! Below is an anecdotal answer:

We run our ci/cd benchmarks on 128dim sift vectors. We have some demos using clip embeddings (512dim) and baai/bge 768 dimensional embeddings.

Generally, smaller vectors allow higher throughput and result in smaller indexes. But the effect on performance is small. Once we merge the PR implementing vector element casts to 1 and 2 byte floats, the effect of this on throughput should be even smaller.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: