2

Can we somehow pass an option to run multiple threads/processes when we call Chroma.from_documents() in Langchain?

I am trying to embed 980 documents (embedding model is mpnet on CUDA), and it take forever. Specs: Software: Ubuntu 20.4 (on Win11 WSL2 host), Langchain version: 0.0.253, pyTorch version: 2.0.1+cu118, Chroma Version: 0.4.2, CUDA 11.8 Processor: Intel i9-13900k at 5.4Ghz all 8 P-cores and 4.3Ghz all remaining 16 E-cores. GPU: RTX 4090 GPU

Paris Char
  • 477
  • 4
  • 17

1 Answers1

0

Chroma now supports multiple threads, so this should be technically possible. Why not simply import threads and spawn multiple loaders?

user3517818
  • 48
  • 6