Also, @nicos this is a separate issue (should I make a new post?), but when making Retool AI resource queries using the different vectors which are both the exact same documents, the version referencing text-embedding-3-small vector is failing to find any relevant information and documents for almost any query while when i reference the vector using text-embedding-ada-002 it does quite well.
Screenshots show same query, same documents, very different performance. and in theory 2-small should outperform ada-002 since it's newer and better
@Nathan_Franklin would you be able to double check if the documents you are expecting are in the vector? (You should be able to see the listed documents in the UI if you navigate to the /vectors page)
Yep - for both vectors I see the same documents actually.
Actually for all three vectors I have the same documents in them.
And it works pretty much identically for queries using Retool Vectors text-embedding-3-large or text-embedding-ada-002 but not really at all for my queries using Retool Vector text-embedding-3-small.
Again same documents in all 3
Thanks for sharing that additional info @Nathan_Franklin. I am still having trouble repro-ing on my side, so I have a couple more questions to help debug further.
Are you using tags/metadata on any of your Vectors? (These can act as filters)
Do you see similar results for each of the embeddings models when using the "Similarity Search" Vector action?
