Questions tagged [pyes]

pyes is a connector to use elasticsearch from python.

pyes is a connector to use elasticsearch from python that features Thrift/HTTP protocols, bulk insert/delete, Index management and facet support.

72 questions
11
votes
3 answers

Elasticsearch GET just after POST

I'm encountering some issues when performing several get_or_create requests to ES. Elasticsearch seems to take some time after responding to the POST to index a document, so much that a GET called just after returns no results. This example…
Léo
  • 469
  • 4
  • 13
9
votes
3 answers

Querying Multi Level Nested fields on Elastic Search

I'm new to Elastic Search and to the non-SQL paradigm. I've been following ES tutorial, but there is one thing I couldn't put to work. In the following code (I'me using PyES to interact with ES) I create a single document, with a nested field…
JCJS
  • 3,031
  • 3
  • 19
  • 25
8
votes
6 answers

Elasticsearch clients for python, no solution

I am having a very bad week having chosen elasticsearch with graylog2. I am trying to run queries against the data in ES using Python. I have tried following clients. ESClient - Very weird results, I think its not maintained, query_body has no…
Abhishek Dujari
  • 2,343
  • 33
  • 43
6
votes
2 answers

How to reindex ElasticSearch quickly?

I have an ElasticSearch index with around 200M documents, total index size of 90Gb. I changed mapping, so I would like ElasticSearch to re-index all the documents. I wrote a script that creates a new index (with the new mapping), then goes over all…
diemacht
  • 2,022
  • 7
  • 30
  • 44
5
votes
1 answer

ElasticSearch: Finding documents with field value that is in an array

I have some customer documents that I want to be retrieved using ElasticSearch based on where the customers come from (country field is IN an array of countries). [ { "name": "A1", "address": { "street": "1 Downing Street" …
Mark
  • 2,137
  • 4
  • 27
  • 42
4
votes
1 answer

Can't translate elasticsearch query into pyes

I need your help to translate a query into pyes. This query is working properly, the problem is that I can't use pyes to make it work: curl -XGET 'http://127.0.0.1:9200/my_index/user/_search?pretty=1' -d '{ "query" : { "bool":{ …
santiagobasulto
  • 11,320
  • 11
  • 64
  • 88
4
votes
5 answers

Elasticsearch python API: Delete documents by query

I see that the following API will do delete by query in Elasticsearch - http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/docs-delete-by-query.html But I want to do the same with the elastic search bulk API, even though I could…
sysuser
  • 1,072
  • 1
  • 13
  • 30
4
votes
1 answer

MapperParsingException: No handler for type [date_hour_minute_second] declared on field

I am developing a driver with Python Pyes client for Elasticsearch. I need mapping indexes with a date column has format No "date_hour_minute_second" based on docs http://www.elasticsearch.org/guide/reference/mapping/date-format/ also I check pyes…
fth
  • 2,478
  • 2
  • 30
  • 44
4
votes
5 answers

Using 'fields' in pyes queries, failing on 0.19.1

Trying to use a fields=[...] paramater in pyes .search is failing Here is a simple test script to illustrate the problem: http://pastebin.com/LiRMC3ib Using the current release of pyes 0.19.1 this script outputs {} as a result of the print…
epoz
  • 43
  • 3
4
votes
1 answer

How to make pyes search method to return the keys of the found documents?

I have a question about pyes (Python API of the ElasticSearch). Is it possible to make the search method to return the keys of the found documents? The code I use: import pyes conn = pyes.ES('localhost:9200') q = pyes.StringQuery("november rain",…
diemacht
  • 2,022
  • 7
  • 30
  • 44
4
votes
1 answer

Managing a pool of connections to a hosted Elastic Search provider

I need a way to manage connections to a hosted Elastic Search provider, to speed up search on my website. We are running Django on Heroku, using the Found ElasticSearch add-on, and pyes, which is an ElasticSearch Python library. The standard way of…
Clay Wardell
  • 14,846
  • 13
  • 44
  • 65
3
votes
1 answer

Building an ElasticSearch search with exists using pyes

The goal of this example code is to figure out how to create a query consisting out of multiple filters and queries. The below example is not working as expected. I want to be able to execute my search only on document which contain a certain…
jay_t
  • 3,593
  • 4
  • 22
  • 27
3
votes
1 answer

pyes range queries syntax

I am trying to convert the below elasticsearch into pyes query and i could not find example on how to use the range queries (especially for time stamps). Can someone help? Elasticsearch Query { "query": { "bool": { "must": [ { …
Linus
  • 825
  • 4
  • 20
  • 33
2
votes
2 answers

How to use Elasticsearch scripting to partial update 500 Million documents as fast as possible

I maintain an index with roughly 500 million documents. Amongst others, each document has a string field that contains between 1 to 10 words. I'd like to analyze this field in each document with regard to its word count and store the result to the…
Jabb
  • 3,414
  • 8
  • 35
  • 58
2
votes
1 answer

How to enhance parallelism in a python client for elasticsearch?

I am new to elasticsearch and I need to optimize a python client to do the search/indexing on a elasticsearch cluster. It seems to me that the bottleneck is the client itself, and that elasticsearch can handle more queries. I would like to know how…
ZianyD
  • 171
  • 2
  • 12
1
2 3 4 5