1

Is anyone getting different results from Azure OpenAI embeddings deployment using text-embedding-ada-002 than the ones from OpenAI? Same text, same model, and the results are considerably far in the vector space.

What's recommended for embeddings?

Talha Tayyab
  • 8,111
  • 25
  • 27
  • 44
Ak123
  • 39
  • 6
  • Hey any new updates on this one? I am not able to find a way to create a deployment with model-version 2 but their docuemnts don't seem to have any details on that - https://learn.microsoft.com/en-us/rest/api/cognitiveservices/azureopenaistable/deployments/update?tabs=HTTP#definitions – technazi May 19 '23 at 19:51

1 Answers1

3

Current AOAI's text-embedding-ada-002 is somewhat different from OAI's. Our model currently supports only 2K tokens, while OAI can support 8K tokens.

Azure OpenAI doesn’t allow batched embeddings. You need to use multiple simultaneous requests. If you hit the maximum req/min, you will need to ask Azure a quota increase.

Ram
  • 2,459
  • 1
  • 7
  • 14