Stack Overflow
Stack Overflow

Questions tagged [databricks-dolly]

7 questions
2
votes
0 answers

Training time for dolly-v2-12b on a custom dataset with an A10 gpu

Hi I am trying to train the dolly-v2-12b or any of the dolly model using a custom dataset using A10 gpu. I am coding in pycharm, windows os. The task is similar to a Q&A. I am trying to use this as communication assistant that can answer the…
Sneha T S
  • 21
  • 6
2
votes
1 answer

How can I use decaying learning rate in DeepSpeed?

I am training dolly2.0. When I do so, I get the following output from the terminal: If I use DeepSpeed to perform this training, I note that the learning rate didn't improve: Why didn't the learning rate improve? This is the DeepSpeed config that…
AndyLinOuO
  • 21
  • 2
0
votes
0 answers

Error using Langchain AzureMLOnlineEndpoint chain.run

Trying a sample implementation from: https://python.langchain.com/docs/integrations/llms/azureml_endpoint_example Dolly with LLMChain Added deployment_name="", from langchain import PromptTemplate from…
Fuzzy Elk
  • 1
  • 1
0
votes
0 answers

How to use langchain to create my own dolly chat robot

I have a operation Manual pdf file about a website and i want to use langchain let dolly can responed the question about the website below is my code: from langchain.embeddings import HuggingFaceEmbeddings from PyPDF2 import PdfReader from…
AndyLinOuO
  • 21
  • 2
0
votes
0 answers

langchain HuggingFaceEmbeddings() model load with 8 bit

I'm trying to use Databricks Dolly model from HuggingFace repo to create embeddings. My 16GB GPU is running out of memory even when I'm using 3B version of the model so I'm trying to load it in 8 bit: embeddings =…
Nik
  • 161
  • 1
  • 13
0
votes
0 answers

GPU out of memory in Jupyter

My OS specs are 8GB dedicated GPU and 24GB shared GPU, I am trying to fine tune a model and I am facing CUDA out of memory errors . I am not able to use Shared memory. Is there any way to use it when my dedicated memory was full. Code Snippet for…
Sai Ganesh
  • 1
  • 1
0
votes
0 answers

Can Databricks Dolly be trained on Databricks tables for generating insights using prompts?

I'm exploring the capabilities of Databricks specifically Databricks Dolly, and I'm wondering if it's possible to train Dolly on Databricks tables to generate insights by writing prompts. I have a Databricks environment set up and I'm working with…
nilesh1212
  • 1,561
  • 2
  • 26
  • 60