I have gone through some of the Stackoveflow question . but I was not able to do the same.
Hive doesnot support update but a workaround for that is to create partition to table.
How to update a record in Hive?
Asked
Active
Viewed 362 times
1 Answers
0
The update feature in Hive is planned in the next release.
As a workaround , You could try the below :
- Add a flag column default as I and a timestamp column
- consider partitions as your primary key fields (combination).
- whenever a new record (updated ) on this primary key combination set the flag as U.
- Write a custom serde class where in only U records are shown.
NOTE : There will be duplicated data , but serde should only show the latest U data corresponding to the latest timestamp in the timestamp column.
K S Nidhin
- 2,622
- 2
- 22
- 44
-
Are we able to do with partitions?http://stackoverflow.com/questions/6200871/update-set-option-in-hive – USB Sep 23 '14 at 03:57
-
i havent work using partitions . Reading the post i guess it might work. – K S Nidhin Sep 23 '14 at 04:51