Stack Overflow
Stack Overflow

Questions tagged [semantic-search]

24 questions
3
votes
1 answer

Semantic searching using Google flan-t5

I'm trying to use google flan t5-large to create embeddings for a simple semantic search engine. However, the generated embeddings cosine similarity with my query is very off. Is there something I'm doing wrong? import torch from transformers import…
Affan Mir
  • 31
  • 2
1
vote
0 answers

Detecting duplicates and managing documents in Redis

Our team uses Redis as a vector store for our Langchain application. We store text chunks as hashes with indexed keys, and fields of metadata, content, and vector. The issue arises when we are trying to identify and remove duplicates from the vector…
Niv Cohen
  • 1,078
  • 2
  • 11
  • 21
1
vote
0 answers

Fine tuning Sentence transformers for semantic product search task

Problem I have at hand is to build a product suggestion model which suggest products based on the context of the search query of a user. My plan is to get a pre-trained model from the sentence-transformers pre-trained models and embed product…
L.D. WEERARATHNE
  • 11
  • 1
1
vote
0 answers

Semantic search and text expansion query with self-deployed model in ElasticSearch

I'm trying to use the elasticsearch text expansion query to implement semantic search on a rank features field. I've read the ELSER documentation and understand the process. I'm using a local/downloaded elasticsearch on docker (not connected to…
camoneme
  • 11
  • 2
1
vote
1 answer

embeddings and semantic search in spanish

I'm building an AI assistant that interacts with custom Q&A stored in a vector database. All examples of it shows as a very simple task of chunking documents (QA in this case), creating embeddings, storing them in a vector DB, and then querying when…
Cristian Sepulveda
  • 1,572
  • 1
  • 18
  • 25
1
vote
1 answer

Getting the AnswerResult from Azure Cognitive Search

Does anyone have an example of getting the Answer from the semantic search in Azure Cognitive Search using c#. This is what I have but I can seem to get the AnswerResult from it. SearchOptions options; SearchResults response; …
Joe Campbell
  • 13
  • 2
1
vote
0 answers

How to perform semantic search on Hebrew documents using AWS OpenSearch?

I am working on a project where I need to perform semantic search on Hebrew documents using AWS OpenSearch. I am wondering if it is possible to perform semantic search on Hebrew documents using OpenSearch? Does OpenSearch support tokenization or a…
daniel
  • 119
  • 1
  • 4
1
vote
1 answer

Azure Cognitive Search - Do sematic search configuration support binding content field to content type in a Edm.ComplexType?

Does Azure cognitive search sematic search configuration support binding content field to content type in a Edm.ComplexType? I have an index which have a collection of complex types. Each item in the complex type has a content string field that has…
Sanny Jacobsson
  • 78
  • 1
  • 7
1
vote
0 answers

Use Word Embedding models in. Elastic Search

I am trying use embedding models in elastic search following this tutorial When I run this command docker run -it --rm elastic/eland \ eland_import_hub_model \ --url https://username:password@localhost:9200/ \ --hub-model-id…
Sazzad
  • 773
  • 11
  • 22
0
votes
0 answers

How to run nearest neighbor search in vespa?

Trying to fetch closest neighbor for my given embedding, using below query: vespa query -v 'yql=select text from VectorSearch3_content where {targetHits:10}nearestNeighbor(embedding,q)' 'hits=1' 'ranking=closeness' 'input.query(q)=$Q' Getting…
Kaushal Singh
  • 13
  • 3
0
votes
0 answers

Json file based Question and answering model using VertexAI

I'm working on document based question and answering model using vertexAI.. But here I'm using Json file instead of document such as PDF or DOCS. Consider that, the 1000s of json file which contains the specific customer information. So I need to…
Karthick Pandian
  • 1
  • 1
0
votes
1 answer

Azure cognitive search- create an Indexer with skillsets to convert pdf file content to vector data and map to Index field ContentVector

I was trying to achieve semantic vector search on my own data. The PDF file will be uploaded into the blob storage, Indexer with skillsets pick up the file content from datasource and map to the index fields: Id, Content and Contentvector. I am able…
sandesh naik
  • 7
  • 4
0
votes
0 answers

Cosine similarity in elasticsearch with multiple vectors per document

I have a "documents" index. Every document has multiple embeddings vectors corresponding to chunks of text of the document. Can I run a cosine similarity script using elasticsearch to get the most similar chunk of text to a query vector? I…
Francesco Pettini
  • 136
  • 1
  • 7
0
votes
1 answer

Semantic video search

I am attempting to extend OpenAI's CLIP functionality to semantic video search. Essentially, my objective is to input a text query and get relevant video segments/clips that match the semantic content of the text query. Here's what I've thought so…
danywigglebutt
  • 238
  • 1
  • 17
0
votes
0 answers

Indexing custom data on Pinecone

So I have a company's data (The data is basically their website dump) and I want this data to be indexed so that I can build a semantic search engine. The data structure is somewhat like this [{'title': 'some title','content':'web page's…
Krishna Gupta
  • 19
  • 1
1
2