Now, I have been test insert, update operations with logstash-input-jdbc plugin, when the mysql changed(insert or update), elasticsearch also changed sync. But when use mysql delete one row, the row exist in the elasticsearch, we can't delete it automatically. Do you have any idea to resolve my problem? Any help would be sincerely appreciate. Thanks !
Asked
Active
Viewed 2,436 times
3
-
Apparently it is not supported by the plugin. I have found a discussion on elastic forum about this : https://discuss.elastic.co/t/delete-elasticsearch-document-with-logstash-jdbc-input/47490/4 – baudsp Jun 22 '16 at 13:57
-
Thanks, I'm laoyang360, you have been answer my question in discuss.elastic.co/t/… – charisMao Jun 23 '16 at 01:39
-
1This answer might help: http://stackoverflow.com/questions/34477095/elasticsearch-replication-of-other-system-data/34477639#34477639 – Val Jun 23 '16 at 04:41
-
@Val, I already answer you at you link above. tks – charisMao Jun 24 '16 at 05:34
-
Another answer that might help: http://stackoverflow.com/questions/35813923/sync-postgresql-data-with-elasticsearch/35823497#35823497 – Val Jun 24 '16 at 05:38
-
Because there is no directly, efficient, good way to resolve the sync delete operation, I think your way of soft-delete is worth learning. – charisMao Jun 24 '16 at 07:37