Stack Overflow
Stack Overflow

Questions tagged [amazon-elasticsearch]

Amazon Elasticsearch Service is a managed Elasticsearch offering as part of Amazon Web Services.

248 questions
108
votes
7 answers

Proper access policy for Amazon Elastic Search Cluster

I've recently started using the new Amazon Elasticsearch Service and I can't seem to figure out the access policy I need so that I can only access the services from my EC2 instances that have a specific IAM role assigned to them. Here's an example…
hartfordfive
  • 1,275
  • 2
  • 11
  • 18
53
votes
5 answers

How to access Kibana from Amazon elasticsearch service?

I created Amazon elasticsearch service and populated data into it using logstash, which has been installed on an EC2 instance. On the Amazon elasticservice console page, there will be a link to access…
AV94
  • 1,824
  • 3
  • 23
  • 36
47
votes
5 answers

ValidationException: Before you can proceed, you must enable a service-linked role to give Amazon ES permissions to access your VPC

I am trying to create a VPC controlled Elastic Search Service on AWS. The problem is I keep getting the error when I run the following code: 'ValidationException: Before you can proceed, you must enable a service-linked role to give Amazon ES…
Michael Young
  • 650
  • 1
  • 6
  • 8
41
votes
3 answers

Multi tenancy in Elastic Search

We are planning to introduce Elastic search(AWS) for our Multi tenancy application. We have below options, Using One Index Per Tenant Using One Type Per Tenant All Tenants Share One Index with Custom routing As per this blog…
Selvakumar Ponnusamy
  • 5,363
  • 7
  • 40
  • 78
28
votes
5 answers

Permissions to access ElasticSearch from Lambda?

I'm trying to use Elasticsearch for data storage for a Lambda function connected to Alexa Skills Kit. The Lambda works alright without Elasticsearch but ES provides much-needed fuzzy matching. The only way I've been able to access it from Lambda is…
Keith
  • 580
  • 1
  • 4
  • 11
28
votes
2 answers

Is there a way to manually set an ElasticSearch document id when inserting via AWS Kinesis Firehose?

I have an AWS Kinesis Firehose Stream set up to feed data into an AWS ElasticSearch cluster, and I can successfully insert documents by sending them to the Firehose Stream, which loads them into ElasticSearch. But I would like to be able to manually…
Alex Coleman
  • 601
  • 7
  • 18
28
votes
5 answers

AWS Elasticsearch Service IAM Role based Access Policy

I have been struggling to figure out how to communicate with the Amazon ES service from my EC2 instances. The documentation clearly states that the Amazon ES service supports IAM User & Role based access policies.…
nackjicholson
  • 4,557
  • 4
  • 37
  • 35
24
votes
1 answer

Can I install plugin on Amazon Elasticsearch Service?

How to install elasticsearch-river-mongodb plugin to Amazon Elasticsearch Service?
Jagdish Idhate
  • 7,513
  • 9
  • 35
  • 51
23
votes
2 answers

How do you handle Amazon Kinesis Record duplicates?

According to the Amazon Kinesis Streams documentation, a record can be delivered multiple times. The only way to be sure to process every record just once is to temporary store them in a database that supports Integrity checks (e.g. DynamoDB,…
Antonio
  • 1,565
  • 3
  • 20
  • 33
15
votes
2 answers

Simplest way to get data from AWS mysql RDS to AWS Elasticsearch?

I have data in an AWS RDS, and I would like to pipe it over to an AWS ES instance, preferably updating once an hour, or similar. On my local machine, with a local mysql database and Elasticsearch database, it was easy to set this up using…
Sam Fen
  • 5,074
  • 5
  • 30
  • 56
15
votes
5 answers

Does Spring Data Elasticsearch support Amazon Elasticsearch?

From the research I have done it seems that the two do not work together because of HTTP only support for Amazon Elasticsearch. Hoping someone can clarify if in fact it is not something that is possible with Spring Data Elasticsearch.
code
  • 4,073
  • 3
  • 27
  • 47
15
votes
2 answers

Elastic Transport client on AWS Managed ElasticSearch

I am trying to use the AWS Managed ElasticSearch for my project. I have followed https://aws.amazon.com/blogs/aws/new-amazon-elasticsearch-service/ and i am able to start an instance and which is successfull. But I am unable to connect to the same…
Ysak
  • 2,601
  • 6
  • 29
  • 53
13
votes
3 answers

What exactly is the primary_term in elastic search?

After reading a lot of documentation, I understood that the primary_term along with the sequence_number are used for optimistic concurrency control in order to prevent an older version of a document overriding a newer one. However, my question is…
Stephanie
  • 133
  • 1
  • 5
13
votes
2 answers

AWS S3 Event notification using Lambda function in Java

I am trying to use Lambda function for S3 Put event notification. My Lambda function should be called once I put/add any new JSON file in my S3 bucket. The challenge I have is there are not enough documents for this to implement such Lambda…
NGR
  • 1,230
  • 2
  • 15
  • 44
13
votes
3 answers

How to talk to aws elasticsearch service using elastic java client?

I have set up a elasticsearch server using AWS elasticsearch service (Not EC2). It gave me an endpoint https://xxx-xxxxxxxx.us-west-2.es.amazonaws.com/ and if I click this endpoint(Note that there is no port specified) I can get the expected { …
Edmond
  • 614
  • 2
  • 11
  • 26
1
2 3
…
16 17