0

I am newbie to Apache Drill.

I am querying hive using apache drill. So, i have to enable that plugin in the web console When i click on hive enable plugin option in the web console, immediately it is throwing exception in the terminal 2:. please help me to solve this issue.

Look at that all the plugins are enabled in the web console except that hive 3:

below is my hive-site.xml file 1:

How do I start Apache Drill correctly?

  • I looked for `Version information not found in metastore` and found this helpful page: https://stackoverflow.com/questions/42209875/hive-2-1-1-metaexceptionmessageversion-information-not-found-in-metastore – tobi6 May 02 '18 at 07:20

1 Answers1

1

Please make sure that you performed schematool -dbType derby -initSchema for Hive metastore 2.1 version (or above) before enabling Drill's Hive storage plugin: https://cwiki.apache.org/confluence/display/Hive/Hive+Schema+Tool

Actually adding datanucleus.schema.autoCreateAll true and hive.metastore.schema.verification: false properties to your plugin could help you, but it is not recomended for production purposes: https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L974

Note: The default values for them depends on the version of Hive you are using.

If you configure Hive metastore properly, the configs from Apache Drill docs should work for you: https://drill.apache.org/docs/hive-storage-plugin/#hive-remote-metastore-configuration

Vitalii Diravka
  • 855
  • 6
  • 11
  • what steps you have mentioned, I followed that but still i am getting the same exception in the terminal. – sabbisetty bhagavan May 03 '18 at 07:22
  • Can you perform Hive queries via Hive CLI? What version of Hive do you use? Please share plugin configs, which you are using. – Vitalii Diravka May 03 '18 at 15:46
  • yeah i am performing queries on hive CLI. i am using hive version 2.3.3. – sabbisetty bhagavan May 04 '18 at 08:52
  • What version of Drill are you using? You should use Drill1.13 to work with Hive2.3.3. Also please do share plugin configs from your 3 reference in the post. – Vitalii Diravka May 06 '18 at 19:03
  • Yeah i am using drill 1.13 to work with hive2.3.3. To know the actual problem, i installed haddop and drill in another system.I got to know that even without installing hive i just run drill in embedded mode. I am getting that same issues like all plugins are enabled but except that hive plugin. plugins like mongodb, hbase etc..are not installed in my system but they are enabling in apache drill web console. i am not understanding why it is like that?can you please help me to resolve this issue. – sabbisetty bhagavan May 08 '18 at 05:13
  • This is the other issue. All plugins are disabled by default (except cp and dfs). In the process of updating plugins configs the templates for them are used. There is a bug when a client is created for some storage even when plugin is disabled. But client for Hive can't be created due to some checks inside the HiveMetaStoreClient. You can find more details here: issues.apache.org/jira/browse/DRILL-6412 But "hive.metastore.schema.verification": "false" property in the Drill Hive storage plugin configs can solve this issue (as workaround). – Vitalii Diravka May 12 '18 at 16:05
  • I assume that it should help you too. If it doesn't, please post your plugin configs that you use for Hive storage plugin. – Vitalii Diravka May 12 '18 at 16:05