Much appreciated if anyone can provide a reference to this clause. I have been searching online with little luck.
Asked
Active
Viewed 3,137 times
17
-
What is "python serde"? Could you add a relevant link? – David דודו Markovitz Feb 11 '17 at 08:25
-
Sorry typo, *json* serde – Da Qi Feb 11 '17 at 15:16
-
1It looks like "path" is useless. See the link here -> https://stackoverflow.com/questions/44118660/serde-properties-list-for-aws-athena-json – Corey Cotton Aug 26 '18 at 12:49
-
Hive doesn't use it. Glue seems to generate that, but I'm not sure how Glue uses it – Neil McGuigan Mar 10 '20 at 16:26
2 Answers
3
It does nothing. There is nothing in the code of the serde that reads the path property – and as far as I can tell there has never been. This is probably documentation that has been handed down generation by generation from the earliest Hive examples.
Theo
- 131,503
- 21
- 160
- 205
-
I know it is used by HiveWarehouseConnector when you try to query hive tables with SparkSQL. – MBillau Jul 09 '20 at 20:56
-
1The context here is Amazon Athena, where it does nothing. It's a serde property and the code for the serde in question does not contain any references to the property. – Theo Jul 10 '20 at 06:55
2
I contacted Amazon with this:
There is some documentation that says: with serdeproperties ( 'paths'='requestBeginTime, adId, impressionId, referrer, userAgent, userCookie, ip' ) This stackoverflow: What does "WITH SERDEPROPERTIES ( 'paths' = 'key1, key2, key3') " really do in Hive DDL json serde? Seems to say that is not needed. Can you remove it or explain it?
and they replied:
Thanks for your feedback. I confirmed that the WITH SERDEPROPERTIES line is not required for the example documented. We’ll get the line removed. Thanks once again for your help in improving the Athena documentation.
markthegrea
- 3,731
- 7
- 55
- 78