We have not run microbenchmarks to see what dimension ranges perform best but those are coming soon! Below is an anecdotal answer:
We run our ci/cd benchmarks on 128dim sift vectors. We have some demos using clip embeddings (512dim) and baai/bge 768 dimensional embeddings.
Generally, smaller vectors allow higher throughput and result in smaller indexes. But the effect on performance is small.
Once we merge the PR implementing vector element casts to 1 and 2 byte floats, the effect of this on throughput should be even smaller.