The typical use case is getting around prompt size limits for information retrieval tasks over large corpora. If you want to ask a question of a large corpus, you first use nearest-neighbor search in embedding space to retrieve snippets likely to contain the answer, and then stuff those snippets into the prompt.