Stack Overflow
Stack Overflow

Questions tagged [similarity-search]

10 questions
2
votes
0 answers

How to save vector embeddings `FAISS` in MongoDB?

I am using LangChain for building some stuff and came across one of the most prominent index-based vector database FAISS. Following is the command of how I am using the FAISS vector database: from langchain.document_loaders import PyMuPDFLoader from…
Shuhul Handoo
  • 122
  • 8
1
vote
0 answers

Dynamic Filtering of Vectors by Community ID in Faiss for Improved Similarity Search

I have a use case where I need to dynamically exclude certain vectors based on specific criteria before performing a similarity search using Faiss. I have explored the Faiss GitHub repository and came across an issue that is closely related to my…
James K J
  • 31
  • 2
0
votes
0 answers

Dynamic vector field weighting in vector database for vector similarity search (redis or other)

I am building a recommendation engine for a project, for which I intend to use a vector database for similarity search (currently using redis for tests). The products I work on have ~15 diferent fields and instead of doing a complex and expensive…
Utorque
  • 13
  • 5
0
votes
1 answer

faiss vectore store delete using keys

i am trying to delete by filtering using metadata source by whrn i get to db.delete(list) i got NotImplementedError: delete method must be implemented by subclass. this is the code: db = FAISS.load_local(FAISS_USERGUIDE_INDEX, embeddings) def…
Hamza Dh
  • 1
  • 1
0
votes
1 answer

Does the question/query vectorized in similaritySearch (Langchain) Does it use tokens

const simpleRes = await vectorStore.similaritySearchWithScore(question); console.log(simpleRes); How can I know if it uses tokens in similarity search, does my question converted to vector and uses OpenAIEmbeddings before it search the closest…
Uno_Count
  • 3
  • 2
0
votes
1 answer

Python API documentation for FAISS

I am searching for a Python API documentation for FAISS, unable to find it. The wiki page says the python translation is very close to the C++ classes whose documentation can be found here
ChrisOdney
  • 6,066
  • 10
  • 38
  • 48
0
votes
1 answer

Redis vector similarity search syntax error

Curently Im working on caching for out chatbot I resided to use native redis similarity search. Their node-redis librarie provide interface to do it. Ando also LangchainJS has options for caching, but it wont work as I need it, because I already…
Denis
  • 3
  • 2
0
votes
0 answers

How to get nearest vector in every cluster of faiss.IndexIVFFlat

I'm using faiss.IndexIVFFlat with nlist=10 to make an index of vectors I want to search. I have a query vector xq and I want to get the vector nearest to xq in each of the 10 clusters in the index. Is there a way to do this with faiss? I see here it…
whitewaterbottle
  • 1
0
votes
0 answers

Using Elasticsearch for fast similarity scoring

I have to find a solution to generate a fast similarity score (a weighted average between jaccard and sorensen-dice similarities) between a person's name and approx 1.5M names divided in 7 CSV lists. Searching online I found that maybe Elasticsearch…
MLonzo
  • 3
  • 3
0
votes
0 answers

Performing similarity search on embedded PDF

I have embedded a PDF using the OPENAI embeddings and have saved it in a local file. Basically I am trying to get a text input, for example: "cat" and perform similarity search. I have tried using the following implementation: const embedder =…
Niccolò
  • 1