Reading this was very valuable. I really appreciate the Vespa mention and introduction to their Multi-Vector HNSW Indexing - I’ve recently thought a lot about how difficult chunking is and this seems like a promising avenue.

This is one of the things we learned recently about building production workflows with LLMs. Happy to answer any questions/feedback here <3

I don't know what a RAG is (and apparently it's forbidden to explain). And at this point, I'm afraid to ask.

Here to learn more about this. Important for a startup I know.

RAG is as valuable as the data you can retrieve.

If the amount of data is small you don't need the flexibility of RAG. And if it is irrelevant it will stay irrelevant after found.