1

I have a synapse pipeline which have multiple activities including a databricks notebook activity. I am able to validate and manually debug pipeline successfully but when I try to publish the pipeline it fails giving error that 'Databricks activity not supported'. Also I am able to publish pipeline when I remove databricks notebook activity. I have checked the databricks linked service also, it is created correctly and able to get a successful connection. I tried to publish similar pipeline including databricks notebook activity in ADF and it is publishing successfully in ADF. I want to publish pipeline in synapse analytics. I am attaching the screenshot of the error I am getting. enter image description here

I tried removing databricks activity and it is publishing successfully. Also tried publishing the similar pipeline including databricks notebook activity in ADF and it is successfully publishing there also. But not able to publish in synapse analytics pipelines.

Attaching the json of notebook activity.enter image description here

Neeraj Bassi
  • 11
  • 3
  • Can you provide Notebook activity configurations or activity JSON? – Rakesh Govindula Jul 11 '23 at 09:26
  • Is it giving the same result when you use the clone of that Notebook activity? – Rakesh Govindula Jul 11 '23 at 09:36
  • Hey @RakeshGovindula I have now attached the json of notebook activity in the question desciption . And even after cloning it gives the error. I tried creating a separate pipeline in synapse with only the clone of databricks notebook activity, but it gave the same issue. – Neeraj Bassi Jul 11 '23 at 10:04
  • I tried the same in my environment, but it is publishing without any errors for me. In your JSON, you did with Repo Notebook. Can you try and check whether it results the same with a normal databricks notebook from `Users`? – Rakesh Govindula Jul 11 '23 at 14:19
  • Tried using normal databricks notebook also, still no luck. – Neeraj Bassi Jul 11 '23 at 17:29
  • Facing the exact same error, this seems to be some kind of bug in Synapse Studio. Does someone know how to raise it to Microsoft or is there any "known issues" tracker? – Sanket Kelkar Jul 12 '23 at 04:37
  • https://stackoverflow.com/questions/76667174/synapse-pipeline-databricks-activity-not-supported the link https://github.com/Azure/Synapse/issues/16 – Ziya Mert Karakas Aug 09 '23 at 19:19

0 Answers0