2

As per the documentation https://cloud.google.com/blog/topics/developers-practitioners/how-build-open-cloud-datalake-delta-lake-presto-dataproc-metastore, delta is natively supported on image versions > 1.5 and jars should be available in the path /usr/lib/delta/jars.

Question:

I have image version '2.1.18-debian11' , but do not see delta-core.jar under the path /usr/lib/delta/jars. Also do not see any option to choose delta (similar to Jupyter notebook) when launching new dataproc cluster. Would like to know if Delta is natively supported on dataproc?

steve
  • 129
  • 2
  • 9
  • Does this answer helps with your inquiry? [https://stackoverflow.com/a/72757046/19378826](https://stackoverflow.com/a/72757046/19378826) – Nestor Ceniza Jr Aug 17 '23 at 19:01

1 Answers1

2

Delta lake is not installed in Dataproc 2.0+, users can bring their own delta lake jars as their job dependencies.

Dagang
  • 24,586
  • 26
  • 88
  • 133