I am using a Spark cluster and I want to write a string to a file and save it to the master node using Scala I looked at this topic and tried some of the suggestions, but I can't find the saved file
Asked
Active
Viewed 1,258 times
0
-
2How to create a [mcve]. – zero323 May 16 '16 at 15:38
1 Answers
0
You would just need to call collect on the RDD to bring the collection back to the driver. Then you can write it to the file system on the driver.
Although it would be recommended to write it in a parallelized fashion for performance.

Michael Stratton
- 107
- 3