3

I turned on Unity Catalog for our workspace. Now a job cluster has an access mode setting. (docs) I can manually change this setting on the UI:

But how do I control this setting when creating the job through databricks jobs create --json-file X.json?

Daniel Darabos
  • 26,991
  • 10
  • 102
  • 114
  • The worst part is, even if I set it manually, running `databricks jobs reset --json-file` resets the access mode to single user. – Daniel Darabos Aug 30 '22 at 10:34

1 Answers1

2

You need to specify the data_security_mode with value "NONE" in the cluster definition (for some reason it's missing from API docs, but you can find details in the Terraform provider docs). But really it should be the default value, so you don't need to explicitly specify it.

Alex Ott
  • 80,552
  • 8
  • 87
  • 132
  • 1
    The docs refer to SINGLE_USER, USER_ISOLATION, LEGACY_PASSTHROUGH and LEGACY_TABLE_ACL. How are those mapped to the options in the UI? Unfortunately I can not find much on that in the documentation, maybe you could point me to some more information on that – Robert Kossendey Aug 30 '22 at 14:57
  • Look here: https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/compute#--what-is-cluster-access-mode - first two are for UC, and last two - without UC – Alex Ott Aug 30 '22 at 15:03
  • So USER_ISOLATION = Shared in the UI? I am unfortunately not able to follow you:( – Robert Kossendey Aug 30 '22 at 15:11
  • Gist of my question would be, how does the security mode map to the cluster access mode, how are those concepts related / mapped? – Robert Kossendey Aug 30 '22 at 15:12
  • 1
    `USER_ISOLATION` - Shared for UC, `LEGACY_PASSTHROUGH` - former Credential Passthrough cluster, `LEGACY_TABLE_ACL` - with Table Access Control instead of UC. `NONE` - Shared, No User isolation – Alex Ott Aug 30 '22 at 15:24
  • Wonderful, thanks! It works! But if I don't specify it, I really get "Single user" by default. Maybe it's a difference between the Terraform provider and the CLI. – Daniel Darabos Aug 30 '22 at 19:25
  • 1
    I think that’s different behavior for UC non-UC. The docs publish for UC is still in progress – Alex Ott Aug 30 '22 at 19:38