Questions tagged [amazon-opensearch]

242 questions
5
votes
1 answer

OpenSearch Java Client: bulk update for existing document results in 400 bad request

I am implementing a bulk update operation using an OpenSearch Java client for existing documents stored in the OpenSearch provisioned by AWS. The BulkRequest request object looks like this: BulkRequest request = new…
Hutsul
  • 1,535
  • 4
  • 31
  • 51
4
votes
1 answer

Force Match phrase to discard results with full email searching only its domain

I'd like to find in my ElasticSearch index the string outlook.com inside a text with a match_phrase query. But I don't want results that are something...@outlook.com, that are taken with this query: GET /my_index/_search { "size": 1, "query": { …
4
votes
1 answer

k-NN multiple field search in OpenSearch

Assume that we have this index in OpenSearch: { "settings": { "index.knn": True, "number_of_replicas": 0, "number_of_shards": 1, }, "mappings": { "properties": { "title": {"type": "text"}, …
Alireza Fa
  • 131
  • 6
4
votes
0 answers

ddbstreams to opensearch via NodeJS lambda

Wanted to sync up the AWS Opensearch with DynamoDB table data. I'm triggering my Lambda function via dynamodb streams and wanted to save it in AWS Opensearch via AWS Lambda. I wanted to do it in NodeJs, but everywhere on internet I can found only…
4
votes
3 answers

How can I bulk upload JSON records to AWS OpenSearch index using a python client library?

I have a sufficiently large dataset that I would like to bulk index the JSON objects in AWS OpenSearch. I cannot see how to achieve this using any of: boto3, awswrangler, opensearch-py, elasticsearch, elasticsearch-py. Is there a way to do this…
3
votes
2 answers

Does AWS Opensearch Support ML Commons Library?

I'm trying to run a simple code example to train and predict a ML algorithm using the Opensearch ML Commons plugin on a AWS managed Opensearch cluster. The cluster is on OS version 2.5, which definitely supports the plugin. The code example can be…
3
votes
0 answers

aws opensearch restore manual snapshot to different cluster

Is there a way to copy an aws opensearch manual snapshot to a different s3 bucket and restore it to a different cluster? I have tf deployment that installs aws opensearch cluster with manual snapshots pointing to s3 configured. These work and i can…
Staggerlee011
  • 847
  • 2
  • 13
  • 23
3
votes
0 answers

How to avoid extra searchable documents? AWS OpenSearch + Searchkick result in increasing document count reindex

I have a ruby/rails application that allows users to search nationwide property data (103 million records). We are using the searchkick gem to take our Property model and store it in a searchable fashion in AWS OpenSearch. When I call…
3
votes
2 answers

how to return all documents that has a subset of input array in OpenSearch

I have a document with given structure: { "name" : "WF1", "myIndex" : [3, 4, 5] } Lets say I have 4 of such records - { "name" : "WF1", "myIndex" : [3, 4, 5] } { "name" : "WF2", "myIndex" : [6, 7, 8] } { "name" : "WF3", "myIndex" : [9, 10, 11] } {…
2
votes
0 answers

AWS OpenSearch Too Many Requests

I have an AWS OpenSearch cluster and I'm working on a rotation system. There is an alias that contains 2 indices, 1 for previous month and 1 for the current month. At the start of a new month I want to store the event data of the previous month to a…
Sobraj
  • 190
  • 2
  • 12
2
votes
0 answers

Execute KNN approximate search using OpenSearch Java client

I am trying to execute KNN approximate search using the OpenSearch Java client. I cant find any example nor documentation about it (both high-level and low-level clients). I am able to execute the command from the OpenSearch dashboard. For…
2
votes
2 answers

AWS OpenSearch Service. Request failed: [security_exception] authentication/authorization failure

I'm trying to use OpenSearch to connect to my OpenSearch domain on AWS. I set env for AWS. However, I'm encountering an authentication/authorization failure. Here's my code: public class Example { public static void main(final String[] args)…
Taras Vovk
  • 21
  • 2
2
votes
2 answers

Need external version support in OpenSearch Update operation

I am using OpenSearch to index JSON documents & make them searchable. All documents have update timestamp field in EPOCH format. The problem is I can get update request where document body contains an older update time. My application should skip…
muthuk
  • 33
  • 5
2
votes
0 answers

Where does AWS OpenSearch domain endpoint points

I am new to OpenSearch or AWS in general. I was trying to debug a recent issue with OpenSearch service when I came across these docs As per this documentation: OpenSearch Service assigns each ENI a private IP address from the IPv4 address range of…
2
votes
0 answers

Metrics and alerts configuration in open search

I am using plugins to export data from opentelementry to open search. I am using below configurations metrics-pipeline: source: otel_metrics_source: ssl: false processor: - otel_metrics_raw_processor: …
1
2 3
16 17