Get all documents from ChromaDb using Python and langchain

Question

I'm using langchain to process a whole bunch of documents which are in an Mongo database.

I can load all documents fine into the chromadb vector storage using langchain. Nothing fancy being done here. This is my code:


from langchain.embeddings.openai import OpenAIEmbeddings
embeddings = OpenAIEmbeddings()

from langchain.vectorstores import Chroma
db = Chroma.from_documents(docs, embeddings, persist_directory='db')
db.persist()

Now, after storing the data, I want to get a list of all the documents and embeddings WITH id's.

This is so I can store them back into MongoDb.

I also want to put them through Bertopic to get the topic categories.

Question 1 is: how do I get all documents I've just stored in the Chroma database? I want the documents, and all the metadata.

Many thanks for your help!

score 5 · Accepted Answer · answered May 06 '23 at 01:34

5

Looking at the source code (https://github.com/hwchase17/langchain/blob/master/langchain/vectorstores/chroma.py)

You can just call below

db.get()

and you will get a json output with the id's, embeddings and docs data.

answered May 06 '23 at 01:34

carteakey

66
4

Nice. However, when I run that, I get: AttributeError: 'Chroma' object has no attribute 'get' – user791793 May 06 '23 at 12:16
Ok, so probably you just need to update langchain, as get was introduced just 4 days ago. Just run 'pip install --upgrade langchain' and try again. – carteakey May 06 '23 at 14:36
How do you do this in another file? – Wamy-Dev May 27 '23 at 05:37

Get all documents from ChromaDb using Python and langchain

1 Answers1

Linked