Questions tagged [spark-bash-azure-databricks]
5 questions
2
votes
2 answers
Databricks init scripts not working sometimes
Ok, it is very strange. I have some init scripts that I would like to run when a cluster starts
cluster has the init script , which is in a file (in dbfs)
basically this
dbfs:/databricks/init-scripts/custom-cert.sh
Now , when I make the init script…
Saugat Mukherjee
- 778
- 8
- 32
1
vote
1 answer
How to read Azure Databricks output using API or class library
I have Azure Databrick notebook which contain SQL command. I need to capture output of SQL command and use in Dot Net core.
Need help.
Prashant Rewatkar
- 11
- 2
0
votes
1 answer
Authorization error on accessing blobs from databricks
Below is the code I am using to access the files in my storage account but I get below error . Is anyone error what wrong am I doing here. The key passed here is correct and so is the container and folder name. The error is received at line…
ZZZSharePoint
- 1,163
- 1
- 19
- 54
0
votes
2 answers
Append dynamic multiple lines header in to an .txt file which as data from data bricks
I am trying to load data in to a abc.txt file form an .csv file which is stored in delta lake.
Example : Data load with | separation in abc.txt file
id|name|address|contact_no
1|abc|xyz1|123
2|efg|xyz2|456
3|hij|xyz3|789
4|klmn|xyz4|91011
Header…
Sai Kiran
- 1
- 1
0
votes
1 answer
Azure Databricks : The backend could not get session tokens for path /mnt. Did you remove the AWS key for the mount point?
I'm trying to Mount Azure Blob storage containers to DBFS. Implementation is as below.
got below following error . Not sure why I'm getting an error Did you remove the AWS key for the mount point? when I'm trying to connect to azure blob…
Sri
- 35
- 7